2026-02-21T12:00:37.121 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-21T12:00:37.136 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T12:00:37.215 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-21_10:47:12-rados-wip-bharath21-testing-2026-02-20-1039-distro-default-trial/62644 branch: wip-bharath21-testing-2026-02-20-1039 description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '62644' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-21_10:47:12-rados-wip-bharath21-testing-2026-02-20-1039-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath21-testing-2026-02-20-1039 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: f7273f3049146bdd7fa7b4a400114872a50228e9 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f7273f3049146bdd7fa7b4a400114872a50228e9 workunit: branch: wip-bharath21-testing-2026-02-20-1039 sha1: f7273f3049146bdd7fa7b4a400114872a50228e9 owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 60 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 6481 sha1: f7273f3049146bdd7fa7b4a400114872a50228e9 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath21-testing-2026-02-20-1039 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f7273f3049146bdd7fa7b4a400114872a50228e9/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f7273f3049146bdd7fa7b4a400114872a50228e9 targets: trial058.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM0dH4mwKIbrnF1gR9KpBqy/CbUoR31E78V09UPVLHqXVgkibIr4SAEba7Wj8GPzTXALJU5iygSn3qzz+xcYtxc= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-21_10:47:12 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-21T12:00:37.215 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f7273f3049146bdd7fa7b4a400114872a50228e9/qa; will attempt to use it 2026-02-21T12:00:37.216 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f7273f3049146bdd7fa7b4a400114872a50228e9/qa/tasks 2026-02-21T12:00:37.216 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-21T12:00:37.217 INFO:teuthology.task.internal:Checking packages... 2026-02-21T12:00:37.218 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f7273f3049146bdd7fa7b4a400114872a50228e9' 2026-02-21T12:00:37.218 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-21T12:00:37.218 INFO:teuthology.packaging:ref: None 2026-02-21T12:00:37.218 INFO:teuthology.packaging:tag: None 2026-02-21T12:00:37.218 INFO:teuthology.packaging:branch: wip-bharath21-testing-2026-02-20-1039 2026-02-21T12:00:37.218 INFO:teuthology.packaging:sha1: f7273f3049146bdd7fa7b4a400114872a50228e9 2026-02-21T12:00:37.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath21-testing-2026-02-20-1039 2026-02-21T12:00:37.341 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5397.gf7273f30 2026-02-21T12:00:37.343 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-21T12:00:37.355 INFO:teuthology.task.internal:no buildpackages task found 2026-02-21T12:00:37.355 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-21T12:00:37.369 INFO:teuthology.task.internal:Saving configuration 2026-02-21T12:00:37.377 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-21T12:00:37.389 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-21T12:00:37.470 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial058.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-21_10:47:12-rados-wip-bharath21-testing-2026-02-20-1039-distro-default-trial/62644', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-21 11:57:11.613349', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM0dH4mwKIbrnF1gR9KpBqy/CbUoR31E78V09UPVLHqXVgkibIr4SAEba7Wj8GPzTXALJU5iygSn3qzz+xcYtxc='} 2026-02-21T12:00:37.471 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-21T12:00:37.482 INFO:teuthology.task.internal:roles: ubuntu@trial058.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-21T12:00:37.482 INFO:teuthology.run_tasks:Running task console_log... 2026-02-21T12:00:37.568 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x795be97fb6a0>, signals=[15]) 2026-02-21T12:00:37.568 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-21T12:00:37.580 INFO:teuthology.task.internal:Opening connections... 2026-02-21T12:00:37.580 DEBUG:teuthology.task.internal:connecting to ubuntu@trial058.front.sepia.ceph.com 2026-02-21T12:00:37.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T12:00:37.643 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-21T12:00:37.654 DEBUG:teuthology.orchestra.run.trial058:> uname -m 2026-02-21T12:00:37.719 INFO:teuthology.orchestra.run.trial058.stdout:x86_64 2026-02-21T12:00:37.719 DEBUG:teuthology.orchestra.run.trial058:> cat /etc/os-release 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:NAME="CentOS Stream" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:VERSION="9" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:ID="centos" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:ID_LIKE="rhel fedora" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:VERSION_ID="9" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:PLATFORM_ID="platform:el9" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:ANSI_COLOR="0;31" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:LOGO="fedora-logo-icon" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:HOME_URL="https://centos.org/" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-21T12:00:37.775 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-21T12:00:37.776 INFO:teuthology.lock.ops:Updating trial058.front.sepia.ceph.com on lock server 2026-02-21T12:00:37.857 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-21T12:00:37.869 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-21T12:00:37.880 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-21T12:00:37.880 DEBUG:teuthology.orchestra.run.trial058:> test '!' -e /home/ubuntu/cephtest 2026-02-21T12:00:37.895 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-21T12:00:37.908 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-21T12:00:37.908 DEBUG:teuthology.orchestra.run.trial058:> test -z $(ls -A /var/lib/ceph) 2026-02-21T12:00:37.951 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-21T12:00:38.034 INFO:teuthology.run_tasks:Running task kernel... 2026-02-21T12:00:38.054 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-21T12:00:38.054 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-21T12:00:38.054 DEBUG:teuthology.orchestra.run.trial058:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-21T12:00:38.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T12:00:38.069 DEBUG:teuthology.orchestra.run.trial058:> uname -r 2026-02-21T12:00:38.125 INFO:teuthology.orchestra.run.trial058.stdout:5.14.0-681.el9.x86_64 2026-02-21T12:00:38.125 INFO:teuthology.task.kernel:Running kernel on trial058: 5.14.0-681.el9.x86_64 2026-02-21T12:00:38.125 DEBUG:teuthology.orchestra.run.trial058:> sudo yum install -y kernel 2026-02-21T12:00:39.695 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 8.9 MB 00:01 2026-02-21T12:00:46.858 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - AppStream 4.0 MB/s | 27 MB 00:06 2026-02-21T12:00:59.053 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - CRB 809 kB/s | 7.8 MB 00:09 2026-02-21T12:01:00.881 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-21T12:01:01.468 INFO:teuthology.orchestra.run.trial058.stdout:Extra Packages for Enterprise Linux 39 MB/s | 20 MB 00:00 2026-02-21T12:01:04.631 INFO:teuthology.orchestra.run.trial058.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-21T12:01:05.637 INFO:teuthology.orchestra.run.trial058.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-21T12:01:05.637 INFO:teuthology.orchestra.run.trial058.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-21T12:01:05.656 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:01:05.657 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:01:05.657 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:01:05.680 DEBUG:teuthology.orchestra.run.trial058:> echo no | sudo yum reinstall kernel || true 2026-02-21T12:01:05.980 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:01 ago on Sat 21 Feb 2026 12:01:04 PM UTC. 2026-02-21T12:01:06.060 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:01:06.061 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:01:06.061 INFO:teuthology.orchestra.run.trial058.stdout: Package Architecture Version Repository Size 2026-02-21T12:01:06.062 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:01:06.062 INFO:teuthology.orchestra.run.trial058.stdout:Reinstalling: 2026-02-21T12:01:06.062 INFO:teuthology.orchestra.run.trial058.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-21T12:01:06.062 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:01:06.062 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-21T12:01:06.062 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:01:06.062 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:01:06.062 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 803 k 2026-02-21T12:01:06.062 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 0 2026-02-21T12:01:06.063 INFO:teuthology.orchestra.run.trial058.stderr:Operation aborted. 2026-02-21T12:01:06.081 INFO:teuthology.orchestra.run.trial058.stdout:Is this ok [y/N]: 2026-02-21T12:01:06.082 DEBUG:teuthology.orchestra.run.trial058:> sudo yum reinstall -y kernel || true 2026-02-21T12:01:06.385 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:02 ago on Sat 21 Feb 2026 12:01:04 PM UTC. 2026-02-21T12:01:06.465 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:01:06.465 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:01:06.465 INFO:teuthology.orchestra.run.trial058.stdout: Package Architecture Version Repository Size 2026-02-21T12:01:06.465 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:01:06.465 INFO:teuthology.orchestra.run.trial058.stdout:Reinstalling: 2026-02-21T12:01:06.465 INFO:teuthology.orchestra.run.trial058.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-21T12:01:06.465 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:01:06.465 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-21T12:01:06.466 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:01:06.466 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:01:06.466 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 803 k 2026-02-21T12:01:06.466 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 0 2026-02-21T12:01:06.466 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-21T12:01:07.423 INFO:teuthology.orchestra.run.trial058.stdout:kernel-5.14.0-681.el9.x86_64.rpm 895 kB/s | 803 kB 00:00 2026-02-21T12:01:07.423 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-21T12:01:07.424 INFO:teuthology.orchestra.run.trial058.stdout:Total 838 kB/s | 803 kB 00:00 2026-02-21T12:01:07.433 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-21T12:01:07.470 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-21T12:01:07.471 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-21T12:01:07.474 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-21T12:01:07.475 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-21T12:01:07.499 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-21T12:01:07.503 INFO:teuthology.orchestra.run.trial058.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-21T12:01:07.503 INFO:teuthology.orchestra.run.trial058.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-21T12:01:07.611 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-21T12:01:07.611 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-21T12:01:07.666 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-21T12:01:07.666 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:01:07.667 INFO:teuthology.orchestra.run.trial058.stdout:Reinstalled: 2026-02-21T12:01:07.667 INFO:teuthology.orchestra.run.trial058.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-21T12:01:07.667 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:01:07.667 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:01:07.694 DEBUG:teuthology.orchestra.run.trial058:> rpm -q kernel | sort -rV | head -n 1 2026-02-21T12:01:07.718 INFO:teuthology.orchestra.run.trial058.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-21T12:01:07.718 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-21T12:01:07.718 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-21T12:01:07.718 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-21T12:01:07.718 DEBUG:teuthology.orchestra.run.trial058:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-21T12:01:07.783 INFO:teuthology.orchestra.run.trial058.stdout:ttyS1 2026-02-21T12:01:07.803 DEBUG:teuthology.parallel:result is None 2026-02-21T12:01:07.803 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-21T12:01:07.810 INFO:teuthology.task.internal:Creating test directory... 2026-02-21T12:01:07.811 DEBUG:teuthology.orchestra.run.trial058:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-21T12:01:07.860 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-21T12:01:07.872 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-21T12:01:07.886 INFO:teuthology.task.internal:Creating archive directory... 2026-02-21T12:01:07.886 DEBUG:teuthology.orchestra.run.trial058:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-21T12:01:07.918 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-21T12:01:07.930 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-21T12:01:07.931 DEBUG:teuthology.orchestra.run.trial058:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-21T12:01:07.981 INFO:teuthology.orchestra.run.trial058.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:01:07.990 INFO:teuthology.orchestra.run.trial058.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:01:07.991 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-21T12:01:08.003 INFO:teuthology.task.internal:Configuring sudo... 2026-02-21T12:01:08.004 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-21T12:01:08.058 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-21T12:01:08.075 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-21T12:01:08.075 DEBUG:teuthology.orchestra.run.trial058:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-21T12:01:08.117 DEBUG:teuthology.orchestra.run.trial058:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-21T12:01:08.278 DEBUG:teuthology.orchestra.run.trial058:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-21T12:01:08.303 DEBUG:teuthology.orchestra.run.trial058:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-21T12:01:08.452 DEBUG:teuthology.orchestra.run.trial058:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-21T12:01:08.476 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-21T12:01:08.477 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-21T12:01:08.540 DEBUG:teuthology.orchestra.run.trial058:> sudo service rsyslog restart 2026-02-21T12:01:08.607 INFO:teuthology.orchestra.run.trial058.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-21T12:01:08.961 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-21T12:01:08.974 INFO:teuthology.task.internal:Starting timer... 2026-02-21T12:01:08.974 INFO:teuthology.run_tasks:Running task pcp... 2026-02-21T12:01:08.995 INFO:teuthology.run_tasks:Running task selinux... 2026-02-21T12:01:09.016 DEBUG:teuthology.orchestra.run.trial058:> sudo service auditd rotate 2026-02-21T12:01:09.046 INFO:teuthology.orchestra.run.trial058.stdout:Rotating logs: 2026-02-21T12:01:09.048 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-21T12:01:09.048 DEBUG:teuthology.orchestra.run.trial058:> /usr/sbin/getenforce 2026-02-21T12:01:09.105 INFO:teuthology.orchestra.run.trial058.stdout:Permissive 2026-02-21T12:01:09.105 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial058.front.sepia.ceph.com': 'permissive'} 2026-02-21T12:01:09.105 DEBUG:teuthology.orchestra.run.trial058:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-21T12:01:09.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T12:01:09.169 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-21T12:01:09.169 DEBUG:teuthology.orchestra.run.trial058:> sudo /usr/sbin/setenforce permissive 2026-02-21T12:01:09.233 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-21T12:01:09.246 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-21T12:01:09.255 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-21T12:01:09.256 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial058.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-21T12:03:51.710 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial058.front.sepia.ceph.com')] 2026-02-21T12:03:51.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-21T12:03:51.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T12:03:51.824 DEBUG:teuthology.orchestra.run.trial058:> true 2026-02-21T12:03:51.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-21T12:03:51.899 INFO:teuthology.run_tasks:Running task clock... 2026-02-21T12:03:51.908 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-21T12:03:51.909 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-21T12:03:51.909 DEBUG:teuthology.orchestra.run.trial058:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-21T12:03:51.966 INFO:teuthology.orchestra.run.trial058.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-21T12:03:51.977 INFO:teuthology.orchestra.run.trial058.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-21T12:03:51.996 INFO:teuthology.orchestra.run.trial058.stderr:sudo: ntpd: command not found 2026-02-21T12:03:52.005 INFO:teuthology.orchestra.run.trial058.stdout:506 Cannot talk to daemon 2026-02-21T12:03:52.017 INFO:teuthology.orchestra.run.trial058.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-21T12:03:52.028 INFO:teuthology.orchestra.run.trial058.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-21T12:03:52.076 INFO:teuthology.orchestra.run.trial058.stderr:bash: line 1: ntpq: command not found 2026-02-21T12:03:52.082 INFO:teuthology.orchestra.run.trial058.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-21T12:03:52.082 INFO:teuthology.orchestra.run.trial058.stdout:=============================================================================== 2026-02-21T12:03:52.083 INFO:teuthology.orchestra.run.trial058.stdout:^? t1.time.gq1.yahoo.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-21T12:03:52.083 INFO:teuthology.orchestra.run.trial058.stdout:^? owners.kjsl.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-21T12:03:52.083 INFO:teuthology.orchestra.run.trial058.stdout:^? 23.186.168.131 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-21T12:03:52.083 INFO:teuthology.orchestra.run.trial058.stdout:^? 72-14-186-59.ip.linodeus> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-21T12:03:52.084 INFO:teuthology.run_tasks:Running task install... 2026-02-21T12:03:52.098 DEBUG:teuthology.task.install:project ceph 2026-02-21T12:03:52.098 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f7273f3049146bdd7fa7b4a400114872a50228e9'}} 2026-02-21T12:03:52.098 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f7273f3049146bdd7fa7b4a400114872a50228e9'} 2026-02-21T12:03:52.098 INFO:teuthology.task.install:Using flavor: default 2026-02-21T12:03:52.114 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-21T12:03:52.115 INFO:teuthology.task.install:extra packages: [] 2026-02-21T12:03:52.116 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f7273f3049146bdd7fa7b4a400114872a50228e9', 'tag': None, 'wait_for_package': False} 2026-02-21T12:03:52.117 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7273f3049146bdd7fa7b4a400114872a50228e9 2026-02-21T12:03:52.278 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath21-testing-2026-02-20-1039/f7273f3049146bdd7fa7b4a400114872a50228e9/centos/9/flavors/default/ 2026-02-21T12:03:52.278 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5397.gf7273f30 2026-02-21T12:03:52.624 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath21-testing-2026-02-20-1039/f7273f3049146bdd7fa7b4a400114872a50228e9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath21-testing-2026-02-20-1039/f7273f3049146bdd7fa7b4a400114872a50228e9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath21-testing-2026-02-20-1039/f7273f3049146bdd7fa7b4a400114872a50228e9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-21T12:03:52.624 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-21T12:03:52.624 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-21T12:03:52.651 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-21T12:03:52.651 DEBUG:teuthology.orchestra.run.trial058:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f7273f3049146bdd7fa7b4a400114872a50228e9/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-21T12:03:52.716 DEBUG:teuthology.orchestra.run.trial058:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-21T12:03:52.792 DEBUG:teuthology.orchestra.run.trial058:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-21T12:03:52.857 INFO:teuthology.orchestra.run.trial058.stdout:check_obsoletes = 1 2026-02-21T12:03:52.859 DEBUG:teuthology.orchestra.run.trial058:> sudo yum clean all 2026-02-21T12:03:53.017 INFO:teuthology.orchestra.run.trial058.stdout:41 files removed 2026-02-21T12:03:53.031 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-radosgw 2026-02-21T12:03:53.778 INFO:teuthology.orchestra.run.trial058.stdout:ceph packages for x86_64 154 kB/s | 94 kB 00:00 2026-02-21T12:03:54.312 INFO:teuthology.orchestra.run.trial058.stdout:ceph noarch packages 48 kB/s | 25 kB 00:00 2026-02-21T12:03:54.756 INFO:teuthology.orchestra.run.trial058.stdout:ceph source packages 4.9 kB/s | 2.1 kB 00:00 2026-02-21T12:03:56.228 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.9 MB 00:01 2026-02-21T12:03:59.723 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 27 MB 00:02 2026-02-21T12:04:02.441 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - CRB 24 MB/s | 7.8 MB 00:00 2026-02-21T12:04:03.620 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 20 kB 00:00 2026-02-21T12:04:04.015 INFO:teuthology.orchestra.run.trial058.stdout:Extra Packages for Enterprise Linux 62 MB/s | 20 MB 00:00 2026-02-21T12:04:07.254 INFO:teuthology.orchestra.run.trial058.stdout:lab-extras 2.1 MB/s | 50 kB 00:00 2026-02-21T12:04:08.452 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repository Size 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: ceph-radosgw x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 13 M 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout:Upgrading: 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: librados2 x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 3.5 M 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: librbd1 x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 2.8 M 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout:Installing dependencies: 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: ceph-base x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 5.2 M 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: ceph-common x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 24 M 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: ceph-selinux x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 25 k 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs2 x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 908 k 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: libradosstriper1 x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 248 k 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-21T12:04:08.453 INFO:teuthology.orchestra.run.trial058.stdout: librgw2 x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 6.5 M 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-argparse x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 45 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-common x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 185 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: python3-cephfs x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 203 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: python3-rados x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 324 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: python3-rbd x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 305 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: python3-rgw x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 100 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout:Installing weak dependencies: 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-daemon x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 37 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 25 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout:Install 35 Packages 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout:Upgrade 2 Packages 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 68 M 2026-02-21T12:04:08.454 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-21T12:04:10.827 INFO:teuthology.orchestra.run.trial058.stdout:(1/37): ceph-base-20.3.0-5397.gf7273f30.el9.x86 2.8 MB/s | 5.2 MB 00:01 2026-02-21T12:04:10.866 INFO:teuthology.orchestra.run.trial058.stdout:(2/37): ceph-selinux-20.3.0-5397.gf7273f30.el9. 631 kB/s | 25 kB 00:00 2026-02-21T12:04:10.888 INFO:teuthology.orchestra.run.trial058.stdout:(3/37): libcephfs-daemon-20.3.0-5397.gf7273f30. 1.7 MB/s | 37 kB 00:00 2026-02-21T12:04:10.910 INFO:teuthology.orchestra.run.trial058.stdout:(4/37): libcephfs-proxy2-20.3.0-5397.gf7273f30. 1.2 MB/s | 25 kB 00:00 2026-02-21T12:04:10.991 INFO:teuthology.orchestra.run.trial058.stdout:(5/37): libcephfs2-20.3.0-5397.gf7273f30.el9.x8 11 MB/s | 908 kB 00:00 2026-02-21T12:04:11.017 INFO:teuthology.orchestra.run.trial058.stdout:(6/37): libradosstriper1-20.3.0-5397.gf7273f30. 9.3 MB/s | 248 kB 00:00 2026-02-21T12:04:11.420 INFO:teuthology.orchestra.run.trial058.stdout:(7/37): librgw2-20.3.0-5397.gf7273f30.el9.x86_6 16 MB/s | 6.5 MB 00:00 2026-02-21T12:04:11.444 INFO:teuthology.orchestra.run.trial058.stdout:(8/37): python3-ceph-argparse-20.3.0-5397.gf727 1.9 MB/s | 45 kB 00:00 2026-02-21T12:04:11.471 INFO:teuthology.orchestra.run.trial058.stdout:(9/37): python3-ceph-common-20.3.0-5397.gf7273f 6.9 MB/s | 185 kB 00:00 2026-02-21T12:04:11.497 INFO:teuthology.orchestra.run.trial058.stdout:(10/37): python3-cephfs-20.3.0-5397.gf7273f30.e 7.5 MB/s | 203 kB 00:00 2026-02-21T12:04:11.527 INFO:teuthology.orchestra.run.trial058.stdout:(11/37): python3-rados-20.3.0-5397.gf7273f30.el 11 MB/s | 324 kB 00:00 2026-02-21T12:04:11.555 INFO:teuthology.orchestra.run.trial058.stdout:(12/37): python3-rbd-20.3.0-5397.gf7273f30.el9. 10 MB/s | 305 kB 00:00 2026-02-21T12:04:11.580 INFO:teuthology.orchestra.run.trial058.stdout:(13/37): python3-rgw-20.3.0-5397.gf7273f30.el9. 4.0 MB/s | 100 kB 00:00 2026-02-21T12:04:11.841 INFO:teuthology.orchestra.run.trial058.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 127 kB/s | 33 kB 00:00 2026-02-21T12:04:12.250 INFO:teuthology.orchestra.run.trial058.stdout:(15/37): ceph-radosgw-20.3.0-5397.gf7273f30.el9 4.0 MB/s | 13 MB 00:03 2026-02-21T12:04:12.324 INFO:teuthology.orchestra.run.trial058.stdout:(16/37): nvme-cli-2.16-1.el9.x86_64.rpm 2.4 MB/s | 1.2 MB 00:00 2026-02-21T12:04:12.364 INFO:teuthology.orchestra.run.trial058.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 2.5 MB/s | 104 kB 00:00 2026-02-21T12:04:12.381 INFO:teuthology.orchestra.run.trial058.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 9.2 MB/s | 164 kB 00:00 2026-02-21T12:04:12.393 INFO:teuthology.orchestra.run.trial058.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 14 MB/s | 160 kB 00:00 2026-02-21T12:04:12.402 INFO:teuthology.orchestra.run.trial058.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.9 MB/s | 45 kB 00:00 2026-02-21T12:04:12.423 INFO:teuthology.orchestra.run.trial058.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 31 MB/s | 662 kB 00:00 2026-02-21T12:04:12.434 INFO:teuthology.orchestra.run.trial058.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 26 MB/s | 292 kB 00:00 2026-02-21T12:04:12.444 INFO:teuthology.orchestra.run.trial058.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 22 MB/s | 240 kB 00:00 2026-02-21T12:04:12.453 INFO:teuthology.orchestra.run.trial058.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 4.1 MB/s | 37 kB 00:00 2026-02-21T12:04:12.463 INFO:teuthology.orchestra.run.trial058.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.1 MB/s | 66 kB 00:00 2026-02-21T12:04:12.640 INFO:teuthology.orchestra.run.trial058.stdout:(26/37): pciutils-3.7.0-7.el9.x86_64.rpm 239 kB/s | 93 kB 00:00 2026-02-21T12:04:12.709 INFO:teuthology.orchestra.run.trial058.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.2 MB/s | 308 kB 00:00 2026-02-21T12:04:12.746 INFO:teuthology.orchestra.run.trial058.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 661 kB/s | 25 kB 00:00 2026-02-21T12:04:12.786 INFO:teuthology.orchestra.run.trial058.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2026-02-21T12:04:12.826 INFO:teuthology.orchestra.run.trial058.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2026-02-21T12:04:12.874 INFO:teuthology.orchestra.run.trial058.stdout:(31/37): ceph-common-20.3.0-5397.gf7273f30.el9. 6.2 MB/s | 24 MB 00:03 2026-02-21T12:04:12.936 INFO:teuthology.orchestra.run.trial058.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.5 MB/s | 838 kB 00:00 2026-02-21T12:04:13.027 INFO:teuthology.orchestra.run.trial058.stdout:(33/37): thrift-0.15.0-4.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2026-02-21T12:04:13.051 INFO:teuthology.orchestra.run.trial058.stdout:(34/37): libarrow-9.0.0-15.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2026-02-21T12:04:13.090 INFO:teuthology.orchestra.run.trial058.stdout:(35/37): re2-20211101-20.el9.x86_64.rpm 889 kB/s | 191 kB 00:00 2026-02-21T12:04:13.161 INFO:teuthology.orchestra.run.trial058.stdout:(36/37): librados2-20.3.0-5397.gf7273f30.el9.x8 26 MB/s | 3.5 MB 00:00 2026-02-21T12:04:13.219 INFO:teuthology.orchestra.run.trial058.stdout:(37/37): librbd1-20.3.0-5397.gf7273f30.el9.x86_ 17 MB/s | 2.8 MB 00:00 2026-02-21T12:04:13.220 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-21T12:04:13.220 INFO:teuthology.orchestra.run.trial058.stdout:Total 14 MB/s | 68 MB 00:04 2026-02-21T12:04:13.318 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-21T12:04:13.337 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-21T12:04:13.337 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-21T12:04:13.610 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-21T12:04:13.610 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-21T12:04:13.919 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-21T12:04:14.071 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-21T12:04:14.076 INFO:teuthology.orchestra.run.trial058.stdout: Upgrading : librados2-2:20.3.0-5397.gf7273f30.el9.x86_64 2/39 2026-02-21T12:04:14.128 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librados2-2:20.3.0-5397.gf7273f30.el9.x86_64 2/39 2026-02-21T12:04:14.130 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs2-2:20.3.0-5397.gf7273f30.el9.x86_64 3/39 2026-02-21T12:04:14.142 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephfs2-2:20.3.0-5397.gf7273f30.el9.x86_64 3/39 2026-02-21T12:04:14.144 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs-daemon-2:20.3.0-5397.gf7273f30.el9.x86_6 4/39 2026-02-21T12:04:14.144 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs-proxy2-2:20.3.0-5397.gf7273f30.el9.x86_6 5/39 2026-02-21T12:04:14.172 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5397.gf7273f30.el9.x86_6 5/39 2026-02-21T12:04:14.174 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rados-2:20.3.0-5397.gf7273f30.el9.x86_64 6/39 2026-02-21T12:04:14.182 INFO:teuthology.orchestra.run.trial058.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-21T12:04:14.184 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-21T12:04:14.187 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-21T12:04:14.191 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-21T12:04:14.202 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-ceph-argparse-2:20.3.0-5397.gf7273f30.el9. 11/39 2026-02-21T12:04:14.214 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cephfs-2:20.3.0-5397.gf7273f30.el9.x86_64 12/39 2026-02-21T12:04:14.215 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libradosstriper1-2:20.3.0-5397.gf7273f30.el9.x86_6 13/39 2026-02-21T12:04:14.236 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5397.gf7273f30.el9.x86_6 13/39 2026-02-21T12:04:14.240 INFO:teuthology.orchestra.run.trial058.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-21T12:04:14.271 INFO:teuthology.orchestra.run.trial058.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-21T12:04:14.274 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-21T12:04:14.280 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-21T12:04:14.283 INFO:teuthology.orchestra.run.trial058.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-21T12:04:14.288 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-21T12:04:14.410 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-21T12:04:14.411 INFO:teuthology.orchestra.run.trial058.stdout: Upgrading : librbd1-2:20.3.0-5397.gf7273f30.el9.x86_64 21/39 2026-02-21T12:04:14.441 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librbd1-2:20.3.0-5397.gf7273f30.el9.x86_64 21/39 2026-02-21T12:04:14.444 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rbd-2:20.3.0-5397.gf7273f30.el9.x86_64 22/39 2026-02-21T12:04:14.453 INFO:teuthology.orchestra.run.trial058.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-21T12:04:14.735 INFO:teuthology.orchestra.run.trial058.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-21T12:04:14.736 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librgw2-2:20.3.0-5397.gf7273f30.el9.x86_64 25/39 2026-02-21T12:04:14.753 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librgw2-2:20.3.0-5397.gf7273f30.el9.x86_64 25/39 2026-02-21T12:04:14.758 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rgw-2:20.3.0-5397.gf7273f30.el9.x86_64 26/39 2026-02-21T12:04:14.762 INFO:teuthology.orchestra.run.trial058.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-21T12:04:14.765 INFO:teuthology.orchestra.run.trial058.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-21T12:04:14.766 INFO:teuthology.orchestra.run.trial058.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-21T12:04:14.784 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-21T12:04:14.902 INFO:teuthology.orchestra.run.trial058.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-21T12:04:14.905 INFO:teuthology.orchestra.run.trial058.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-21T12:04:15.207 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-21T12:04:15.207 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-21T12:04:15.207 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:15.254 INFO:teuthology.orchestra.run.trial058.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-21T12:04:15.256 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-ceph-common-2:20.3.0-5397.gf7273f30.el9.x8 33/39 2026-02-21T12:04:16.347 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-common-2:20.3.0-5397.gf7273f30.el9.x86_64 34/39 2026-02-21T12:04:16.349 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-common-2:20.3.0-5397.gf7273f30.el9.x86_64 34/39 2026-02-21T12:04:16.611 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-common-2:20.3.0-5397.gf7273f30.el9.x86_64 34/39 2026-02-21T12:04:16.614 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-base-2:20.3.0-5397.gf7273f30.el9.x86_64 35/39 2026-02-21T12:04:16.655 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-base-2:20.3.0-5397.gf7273f30.el9.x86_64 35/39 2026-02-21T12:04:16.655 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-21T12:04:16.655 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-21T12:04:16.655 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:16.658 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-selinux-2:20.3.0-5397.gf7273f30.el9.x86_64 36/39 2026-02-21T12:04:21.151 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5397.gf7273f30.el9.x86_64 36/39 2026-02-21T12:04:21.151 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /sys 2026-02-21T12:04:21.151 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /proc 2026-02-21T12:04:21.151 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /mnt 2026-02-21T12:04:21.151 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /var/tmp 2026-02-21T12:04:21.151 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /home 2026-02-21T12:04:21.151 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /root 2026-02-21T12:04:21.151 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /tmp 2026-02-21T12:04:21.151 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:21.726 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-radosgw-2:20.3.0-5397.gf7273f30.el9.x86_64 37/39 2026-02-21T12:04:21.748 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5397.gf7273f30.el9.x86_64 37/39 2026-02-21T12:04:21.749 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T12:04:21.749 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-21T12:04:21.749 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-21T12:04:21.749 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-21T12:04:21.749 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:21.750 INFO:teuthology.orchestra.run.trial058.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-21T12:04:21.761 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-21T12:04:21.761 INFO:teuthology.orchestra.run.trial058.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-21T12:04:21.816 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-21T12:04:21.816 INFO:teuthology.orchestra.run.trial058.stdout:Creating group 'qat' with GID 992. 2026-02-21T12:04:21.816 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:22.131 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-base-2:20.3.0-5397.gf7273f30.el9.x86_64 1/39 2026-02-21T12:04:22.131 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-common-2:20.3.0-5397.gf7273f30.el9.x86_64 2/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-radosgw-2:20.3.0-5397.gf7273f30.el9.x86_64 3/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-selinux-2:20.3.0-5397.gf7273f30.el9.x86_64 4/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs-daemon-2:20.3.0-5397.gf7273f30.el9.x86_6 5/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5397.gf7273f30.el9.x86_6 6/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs2-2:20.3.0-5397.gf7273f30.el9.x86_64 7/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libradosstriper1-2:20.3.0-5397.gf7273f30.el9.x86_6 8/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librgw2-2:20.3.0-5397.gf7273f30.el9.x86_64 9/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5397.gf7273f30.el9. 10/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-ceph-common-2:20.3.0-5397.gf7273f30.el9.x8 11/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cephfs-2:20.3.0-5397.gf7273f30.el9.x86_64 12/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rados-2:20.3.0-5397.gf7273f30.el9.x86_64 13/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rbd-2:20.3.0-5397.gf7273f30.el9.x86_64 14/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rgw-2:20.3.0-5397.gf7273f30.el9.x86_64 15/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-21T12:04:22.132 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librados2-2:20.3.0-5397.gf7273f30.el9.x86_64 36/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-21T12:04:22.133 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librbd1-2:20.3.0-5397.gf7273f30.el9.x86_64 38/39 2026-02-21T12:04:22.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-21T12:04:22.194 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:22.194 INFO:teuthology.orchestra.run.trial058.stdout:Upgraded: 2026-02-21T12:04:22.194 INFO:teuthology.orchestra.run.trial058.stdout: librados2-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.194 INFO:teuthology.orchestra.run.trial058.stdout: librbd1-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.194 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-21T12:04:22.194 INFO:teuthology.orchestra.run.trial058.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-21T12:04:22.194 INFO:teuthology.orchestra.run.trial058.stdout: ceph-base-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.194 INFO:teuthology.orchestra.run.trial058.stdout: ceph-common-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.194 INFO:teuthology.orchestra.run.trial058.stdout: ceph-radosgw-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.194 INFO:teuthology.orchestra.run.trial058.stdout: ceph-selinux-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.195 INFO:teuthology.orchestra.run.trial058.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-21T12:04:22.195 INFO:teuthology.orchestra.run.trial058.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-21T12:04:22.195 INFO:teuthology.orchestra.run.trial058.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-21T12:04:22.195 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-daemon-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.195 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-proxy2-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.195 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs2-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.195 INFO:teuthology.orchestra.run.trial058.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-21T12:04:22.195 INFO:teuthology.orchestra.run.trial058.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-21T12:04:22.195 INFO:teuthology.orchestra.run.trial058.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-21T12:04:22.195 INFO:teuthology.orchestra.run.trial058.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-21T12:04:22.195 INFO:teuthology.orchestra.run.trial058.stdout: libradosstriper1-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.195 INFO:teuthology.orchestra.run.trial058.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-21T12:04:22.196 INFO:teuthology.orchestra.run.trial058.stdout: librgw2-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.196 INFO:teuthology.orchestra.run.trial058.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-21T12:04:22.196 INFO:teuthology.orchestra.run.trial058.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-21T12:04:22.196 INFO:teuthology.orchestra.run.trial058.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-21T12:04:22.196 INFO:teuthology.orchestra.run.trial058.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-21T12:04:22.196 INFO:teuthology.orchestra.run.trial058.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-21T12:04:22.196 INFO:teuthology.orchestra.run.trial058.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-21T12:04:22.196 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-argparse-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.196 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-common-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.196 INFO:teuthology.orchestra.run.trial058.stdout: python3-cephfs-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.196 INFO:teuthology.orchestra.run.trial058.stdout: python3-rados-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.196 INFO:teuthology.orchestra.run.trial058.stdout: python3-rbd-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.197 INFO:teuthology.orchestra.run.trial058.stdout: python3-rgw-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:22.197 INFO:teuthology.orchestra.run.trial058.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-21T12:04:22.197 INFO:teuthology.orchestra.run.trial058.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-21T12:04:22.197 INFO:teuthology.orchestra.run.trial058.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-21T12:04:22.197 INFO:teuthology.orchestra.run.trial058.stdout: re2-1:20211101-20.el9.x86_64 2026-02-21T12:04:22.197 INFO:teuthology.orchestra.run.trial058.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-21T12:04:22.197 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:22.197 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:04:22.235 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-test 2026-02-21T12:04:22.547 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:15 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:04:22.630 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:04:22.631 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:04:22.632 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repository Size 2026-02-21T12:04:22.632 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:04:22.632 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-21T12:04:22.632 INFO:teuthology.orchestra.run.trial058.stdout: ceph-test x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 76 M 2026-02-21T12:04:22.632 INFO:teuthology.orchestra.run.trial058.stdout:Installing dependencies: 2026-02-21T12:04:22.632 INFO:teuthology.orchestra.run.trial058.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-21T12:04:22.632 INFO:teuthology.orchestra.run.trial058.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-21T12:04:22.632 INFO:teuthology.orchestra.run.trial058.stdout: libcephsqlite x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 159 k 2026-02-21T12:04:22.632 INFO:teuthology.orchestra.run.trial058.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-21T12:04:22.632 INFO:teuthology.orchestra.run.trial058.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-21T12:04:22.633 INFO:teuthology.orchestra.run.trial058.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-21T12:04:22.633 INFO:teuthology.orchestra.run.trial058.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-21T12:04:22.633 INFO:teuthology.orchestra.run.trial058.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-21T12:04:22.633 INFO:teuthology.orchestra.run.trial058.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-21T12:04:22.633 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:22.633 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-21T12:04:22.633 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:04:22.633 INFO:teuthology.orchestra.run.trial058.stdout:Install 10 Packages 2026-02-21T12:04:22.633 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:22.633 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 80 M 2026-02-21T12:04:22.633 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 331 M 2026-02-21T12:04:22.634 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-21T12:04:22.896 INFO:teuthology.orchestra.run.trial058.stdout:(1/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 52 MB/s | 2.1 MB 00:00 2026-02-21T12:04:22.900 INFO:teuthology.orchestra.run.trial058.stdout:(2/10): libatomic-11.5.0-14.el9.x86_64.rpm 5.3 MB/s | 23 kB 00:00 2026-02-21T12:04:22.910 INFO:teuthology.orchestra.run.trial058.stdout:(3/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 9.0 MB/s | 94 kB 00:00 2026-02-21T12:04:23.000 INFO:teuthology.orchestra.run.trial058.stdout:(4/10): libxslt-1.1.34-12.el9.x86_64.rpm 2.6 MB/s | 233 kB 00:00 2026-02-21T12:04:23.078 INFO:teuthology.orchestra.run.trial058.stdout:(5/10): protobuf-3.14.0-17.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2026-02-21T12:04:23.102 INFO:teuthology.orchestra.run.trial058.stdout:(6/10): socat-1.7.4.1-8.el9.x86_64.rpm 12 MB/s | 303 kB 00:00 2026-02-21T12:04:23.124 INFO:teuthology.orchestra.run.trial058.stdout:(7/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-21T12:04:23.225 INFO:teuthology.orchestra.run.trial058.stdout:(8/10): libcephsqlite-20.3.0-5397.gf7273f30.el9 430 kB/s | 159 kB 00:00 2026-02-21T12:04:23.499 INFO:teuthology.orchestra.run.trial058.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 325 kB/s | 122 kB 00:00 2026-02-21T12:04:26.552 INFO:teuthology.orchestra.run.trial058.stdout:(10/10): ceph-test-20.3.0-5397.gf7273f30.el9.x8 21 MB/s | 76 MB 00:03 2026-02-21T12:04:26.553 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-21T12:04:26.553 INFO:teuthology.orchestra.run.trial058.stdout:Total 20 MB/s | 80 MB 00:03 2026-02-21T12:04:26.618 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-21T12:04:26.628 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-21T12:04:26.628 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-21T12:04:26.902 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-21T12:04:26.902 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-21T12:04:27.205 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-21T12:04:27.214 INFO:teuthology.orchestra.run.trial058.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-21T12:04:27.222 INFO:teuthology.orchestra.run.trial058.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-21T12:04:27.227 INFO:teuthology.orchestra.run.trial058.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-21T12:04:27.232 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-21T12:04:27.237 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-21T12:04:27.239 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-21T12:04:27.249 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-21T12:04:27.257 INFO:teuthology.orchestra.run.trial058.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-21T12:04:27.258 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephsqlite-2:20.3.0-5397.gf7273f30.el9.x86_64 9/10 2026-02-21T12:04:30.601 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5397.gf7273f30.el9.x86_64 9/10 2026-02-21T12:04:30.621 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-test-2:20.3.0-5397.gf7273f30.el9.x86_64 10/10 2026-02-21T12:04:30.942 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-test-2:20.3.0-5397.gf7273f30.el9.x86_64 10/10 2026-02-21T12:04:30.942 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-test-2:20.3.0-5397.gf7273f30.el9.x86_64 1/10 2026-02-21T12:04:30.942 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephsqlite-2:20.3.0-5397.gf7273f30.el9.x86_64 2/10 2026-02-21T12:04:30.942 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-21T12:04:30.942 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-21T12:04:30.942 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-21T12:04:30.942 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-21T12:04:30.942 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-21T12:04:30.942 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-21T12:04:30.942 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-21T12:04:30.996 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-21T12:04:30.996 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:30.996 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-21T12:04:30.996 INFO:teuthology.orchestra.run.trial058.stdout: ceph-test-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:30.996 INFO:teuthology.orchestra.run.trial058.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-21T12:04:30.997 INFO:teuthology.orchestra.run.trial058.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-21T12:04:30.997 INFO:teuthology.orchestra.run.trial058.stdout: libcephsqlite-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:30.997 INFO:teuthology.orchestra.run.trial058.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-21T12:04:30.997 INFO:teuthology.orchestra.run.trial058.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-21T12:04:30.997 INFO:teuthology.orchestra.run.trial058.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-21T12:04:30.997 INFO:teuthology.orchestra.run.trial058.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-21T12:04:30.997 INFO:teuthology.orchestra.run.trial058.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-21T12:04:30.997 INFO:teuthology.orchestra.run.trial058.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-21T12:04:30.997 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:30.997 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:04:31.035 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph 2026-02-21T12:04:31.337 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:24 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:04:31.423 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:04:31.426 INFO:teuthology.orchestra.run.trial058.stdout:======================================================================================= 2026-02-21T12:04:31.426 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repository Size 2026-02-21T12:04:31.426 INFO:teuthology.orchestra.run.trial058.stdout:======================================================================================= 2026-02-21T12:04:31.427 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-21T12:04:31.427 INFO:teuthology.orchestra.run.trial058.stdout: ceph x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 6.5 k 2026-02-21T12:04:31.427 INFO:teuthology.orchestra.run.trial058.stdout:Installing dependencies: 2026-02-21T12:04:31.427 INFO:teuthology.orchestra.run.trial058.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-21T12:04:31.427 INFO:teuthology.orchestra.run.trial058.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5397.gf7273f30.el9 ceph-noarch 57 k 2026-02-21T12:04:31.427 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mds x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 2.4 M 2026-02-21T12:04:31.427 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 950 k 2026-02-21T12:04:31.427 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5397.gf7273f30.el9 ceph-noarch 297 k 2026-02-21T12:04:31.427 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mon x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 5.0 M 2026-02-21T12:04:31.427 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 166 k 2026-02-21T12:04:31.427 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-classic x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 16 M 2026-02-21T12:04:31.428 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-crimson x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 19 M 2026-02-21T12:04:31.428 INFO:teuthology.orchestra.run.trial058.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5397.gf7273f30.el9 ceph-noarch 17 k 2026-02-21T12:04:31.428 INFO:teuthology.orchestra.run.trial058.stdout: cephadm noarch 2:20.3.0-5397.gf7273f30.el9 ceph-noarch 1.0 M 2026-02-21T12:04:31.428 INFO:teuthology.orchestra.run.trial058.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-21T12:04:31.428 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-21T12:04:31.428 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-21T12:04:31.428 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-21T12:04:31.428 INFO:teuthology.orchestra.run.trial058.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-21T12:04:31.428 INFO:teuthology.orchestra.run.trial058.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-21T12:04:31.428 INFO:teuthology.orchestra.run.trial058.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-21T12:04:31.428 INFO:teuthology.orchestra.run.trial058.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-21T12:04:31.428 INFO:teuthology.orchestra.run.trial058.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-21T12:04:31.429 INFO:teuthology.orchestra.run.trial058.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-21T12:04:31.429 INFO:teuthology.orchestra.run.trial058.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-21T12:04:31.429 INFO:teuthology.orchestra.run.trial058.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-21T12:04:31.429 INFO:teuthology.orchestra.run.trial058.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-21T12:04:31.429 INFO:teuthology.orchestra.run.trial058.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-21T12:04:31.429 INFO:teuthology.orchestra.run.trial058.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-21T12:04:31.429 INFO:teuthology.orchestra.run.trial058.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-21T12:04:31.429 INFO:teuthology.orchestra.run.trial058.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-21T12:04:31.429 INFO:teuthology.orchestra.run.trial058.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-21T12:04:31.429 INFO:teuthology.orchestra.run.trial058.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-21T12:04:31.429 INFO:teuthology.orchestra.run.trial058.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-21T12:04:31.429 INFO:teuthology.orchestra.run.trial058.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-21T12:04:31.430 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-21T12:04:31.431 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-21T12:04:31.431 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-21T12:04:31.431 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-21T12:04:31.431 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-21T12:04:31.431 INFO:teuthology.orchestra.run.trial058.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-21T12:04:31.431 INFO:teuthology.orchestra.run.trial058.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-21T12:04:31.431 INFO:teuthology.orchestra.run.trial058.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-21T12:04:31.431 INFO:teuthology.orchestra.run.trial058.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-21T12:04:31.431 INFO:teuthology.orchestra.run.trial058.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-21T12:04:31.431 INFO:teuthology.orchestra.run.trial058.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-21T12:04:31.431 INFO:teuthology.orchestra.run.trial058.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-21T12:04:31.431 INFO:teuthology.orchestra.run.trial058.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-21T12:04:31.432 INFO:teuthology.orchestra.run.trial058.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-21T12:04:31.433 INFO:teuthology.orchestra.run.trial058.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-21T12:04:31.434 INFO:teuthology.orchestra.run.trial058.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-21T12:04:31.434 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-21T12:04:31.434 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-21T12:04:31.434 INFO:teuthology.orchestra.run.trial058.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-21T12:04:31.434 INFO:teuthology.orchestra.run.trial058.stdout:Installing weak dependencies: 2026-02-21T12:04:31.434 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5397.gf7273f30.el9 ceph-noarch 184 k 2026-02-21T12:04:31.434 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5397.gf7273f30.el9 ceph-noarch 51 M 2026-02-21T12:04:31.434 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5397.gf7273f30.el9 ceph-noarch 7.4 M 2026-02-21T12:04:31.434 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5397.gf7273f30.el9 ceph-noarch 22 k 2026-02-21T12:04:31.434 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-rook noarch 2:20.3.0-5397.gf7273f30.el9 ceph-noarch 50 k 2026-02-21T12:04:31.434 INFO:teuthology.orchestra.run.trial058.stdout: ceph-volume noarch 2:20.3.0-5397.gf7273f30.el9 ceph-noarch 301 k 2026-02-21T12:04:31.434 INFO:teuthology.orchestra.run.trial058.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-21T12:04:31.435 INFO:teuthology.orchestra.run.trial058.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-21T12:04:31.435 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:31.435 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-21T12:04:31.435 INFO:teuthology.orchestra.run.trial058.stdout:======================================================================================= 2026-02-21T12:04:31.435 INFO:teuthology.orchestra.run.trial058.stdout:Install 96 Packages 2026-02-21T12:04:31.435 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:31.436 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 158 M 2026-02-21T12:04:31.436 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 732 M 2026-02-21T12:04:31.436 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-21T12:04:32.215 INFO:teuthology.orchestra.run.trial058.stdout:(1/96): ceph-20.3.0-5397.gf7273f30.el9.x86_64.r 27 kB/s | 6.5 kB 00:00 2026-02-21T12:04:32.672 INFO:teuthology.orchestra.run.trial058.stdout:(2/96): ceph-mgr-20.3.0-5397.gf7273f30.el9.x86_ 1.3 MB/s | 950 kB 00:00 2026-02-21T12:04:32.729 INFO:teuthology.orchestra.run.trial058.stdout:(3/96): ceph-osd-20.3.0-5397.gf7273f30.el9.x86_ 2.9 MB/s | 166 kB 00:00 2026-02-21T12:04:33.135 INFO:teuthology.orchestra.run.trial058.stdout:(4/96): ceph-mds-20.3.0-5397.gf7273f30.el9.x86_ 2.0 MB/s | 2.4 MB 00:01 2026-02-21T12:04:34.013 INFO:teuthology.orchestra.run.trial058.stdout:(5/96): ceph-mon-20.3.0-5397.gf7273f30.el9.x86_ 2.8 MB/s | 5.0 MB 00:01 2026-02-21T12:04:34.074 INFO:teuthology.orchestra.run.trial058.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5397.gf7 945 kB/s | 57 kB 00:00 2026-02-21T12:04:34.137 INFO:teuthology.orchestra.run.trial058.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5397.gf7273f30. 2.9 MB/s | 184 kB 00:00 2026-02-21T12:04:36.386 INFO:teuthology.orchestra.run.trial058.stdout:(8/96): ceph-osd-classic-20.3.0-5397.gf7273f30. 4.3 MB/s | 16 MB 00:03 2026-02-21T12:04:37.270 INFO:teuthology.orchestra.run.trial058.stdout:(9/96): ceph-osd-crimson-20.3.0-5397.gf7273f30. 4.6 MB/s | 19 MB 00:04 2026-02-21T12:04:37.308 INFO:teuthology.orchestra.run.trial058.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5397.gf7273f 590 kB/s | 22 kB 00:00 2026-02-21T12:04:37.392 INFO:teuthology.orchestra.run.trial058.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5397.gf72 3.5 MB/s | 297 kB 00:00 2026-02-21T12:04:37.432 INFO:teuthology.orchestra.run.trial058.stdout:(12/96): ceph-mgr-rook-20.3.0-5397.gf7273f30.el 1.2 MB/s | 50 kB 00:00 2026-02-21T12:04:37.471 INFO:teuthology.orchestra.run.trial058.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5397.gf7 451 kB/s | 17 kB 00:00 2026-02-21T12:04:37.549 INFO:teuthology.orchestra.run.trial058.stdout:(14/96): ceph-volume-20.3.0-5397.gf7273f30.el9. 3.8 MB/s | 301 kB 00:00 2026-02-21T12:04:37.592 INFO:teuthology.orchestra.run.trial058.stdout:(15/96): ceph-mgr-diskprediction-local-20.3.0-5 6.1 MB/s | 7.4 MB 00:01 2026-02-21T12:04:37.732 INFO:teuthology.orchestra.run.trial058.stdout:(16/96): cephadm-20.3.0-5397.gf7273f30.el9.noar 5.5 MB/s | 1.0 MB 00:00 2026-02-21T12:04:38.012 INFO:teuthology.orchestra.run.trial058.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 144 kB/s | 40 kB 00:00 2026-02-21T12:04:38.135 INFO:teuthology.orchestra.run.trial058.stdout:(18/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 647 kB/s | 351 kB 00:00 2026-02-21T12:04:38.204 INFO:teuthology.orchestra.run.trial058.stdout:(19/96): libconfig-1.7.2-9.el9.x86_64.rpm 375 kB/s | 72 kB 00:00 2026-02-21T12:04:38.354 INFO:teuthology.orchestra.run.trial058.stdout:(20/96): libgfortran-11.5.0-14.el9.x86_64.rpm 3.5 MB/s | 794 kB 00:00 2026-02-21T12:04:38.402 INFO:teuthology.orchestra.run.trial058.stdout:(21/96): libquadmath-11.5.0-14.el9.x86_64.rpm 934 kB/s | 184 kB 00:00 2026-02-21T12:04:38.451 INFO:teuthology.orchestra.run.trial058.stdout:(22/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 253 kB 00:00 2026-02-21T12:04:38.537 INFO:teuthology.orchestra.run.trial058.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2026-02-21T12:04:38.624 INFO:teuthology.orchestra.run.trial058.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 1.5 MB/s | 135 kB 00:00 2026-02-21T12:04:38.706 INFO:teuthology.orchestra.run.trial058.stdout:(25/96): python3-cryptography-36.0.1-5.el9.x86_ 4.1 MB/s | 1.2 MB 00:00 2026-02-21T12:04:38.712 INFO:teuthology.orchestra.run.trial058.stdout:(26/96): python3-pyparsing-2.4.7-9.el9.noarch.r 1.7 MB/s | 150 kB 00:00 2026-02-21T12:04:38.789 INFO:teuthology.orchestra.run.trial058.stdout:(27/96): python3-requests-2.25.1-10.el9.noarch. 1.5 MB/s | 126 kB 00:00 2026-02-21T12:04:38.805 INFO:teuthology.orchestra.run.trial058.stdout:(28/96): python3-urllib3-1.26.5-7.el9.noarch.rp 2.3 MB/s | 218 kB 00:00 2026-02-21T12:04:38.874 INFO:teuthology.orchestra.run.trial058.stdout:(29/96): unzip-6.0-59.el9.x86_64.rpm 2.1 MB/s | 182 kB 00:00 2026-02-21T12:04:38.901 INFO:teuthology.orchestra.run.trial058.stdout:(30/96): zip-3.0-35.el9.x86_64.rpm 2.7 MB/s | 266 kB 00:00 2026-02-21T12:04:39.324 INFO:teuthology.orchestra.run.trial058.stdout:(31/96): flexiblas-3.0.4-9.el9.x86_64.rpm 66 kB/s | 30 kB 00:00 2026-02-21T12:04:39.424 INFO:teuthology.orchestra.run.trial058.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 150 kB/s | 15 kB 00:00 2026-02-21T12:04:39.837 INFO:teuthology.orchestra.run.trial058.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 595 kB/s | 246 kB 00:00 2026-02-21T12:04:40.094 INFO:teuthology.orchestra.run.trial058.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 733 kB/s | 188 kB 00:00 2026-02-21T12:04:40.194 INFO:teuthology.orchestra.run.trial058.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 424 kB/s | 42 kB 00:00 2026-02-21T12:04:43.729 INFO:teuthology.orchestra.run.trial058.stdout:(36/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 634 kB/s | 3.0 MB 00:04 2026-02-21T12:04:43.950 INFO:teuthology.orchestra.run.trial058.stdout:(37/96): ceph-mgr-dashboard-20.3.0-5397.gf7273f 5.2 MB/s | 51 MB 00:09 2026-02-21T12:04:44.427 INFO:teuthology.orchestra.run.trial058.stdout:(38/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 1.2 MB/s | 5.3 MB 00:04 2026-02-21T12:04:44.529 INFO:teuthology.orchestra.run.trial058.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.4 MB/s | 249 kB 00:00 2026-02-21T12:04:44.629 INFO:teuthology.orchestra.run.trial058.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 479 kB/s | 48 kB 00:00 2026-02-21T12:04:44.678 INFO:teuthology.orchestra.run.trial058.stdout:(41/96): python3-devel-3.9.25-3.el9.x86_64.rpm 336 kB/s | 244 kB 00:00 2026-02-21T12:04:44.729 INFO:teuthology.orchestra.run.trial058.stdout:(42/96): python3-libstoragemgmt-1.10.1-1.el9.x8 1.7 MB/s | 177 kB 00:00 2026-02-21T12:04:44.828 INFO:teuthology.orchestra.run.trial058.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 349 kB/s | 35 kB 00:00 2026-02-21T12:04:45.096 INFO:teuthology.orchestra.run.trial058.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 23 MB/s | 6.1 MB 00:00 2026-02-21T12:04:45.166 INFO:teuthology.orchestra.run.trial058.stdout:(45/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 2.5 MB/s | 1.2 MB 00:00 2026-02-21T12:04:45.198 INFO:teuthology.orchestra.run.trial058.stdout:(46/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 4.2 MB/s | 442 kB 00:00 2026-02-21T12:04:45.266 INFO:teuthology.orchestra.run.trial058.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 779 kB/s | 77 kB 00:00 2026-02-21T12:04:45.299 INFO:teuthology.orchestra.run.trial058.stdout:(48/96): python3-protobuf-3.14.0-17.el9.noarch. 2.6 MB/s | 267 kB 00:00 2026-02-21T12:04:45.366 INFO:teuthology.orchestra.run.trial058.stdout:(49/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2026-02-21T12:04:45.399 INFO:teuthology.orchestra.run.trial058.stdout:(50/96): python3-pyasn1-modules-0.4.8-6.el9.noa 2.7 MB/s | 279 kB 00:00 2026-02-21T12:04:45.464 INFO:teuthology.orchestra.run.trial058.stdout:(51/96): python3-requests-oauthlib-1.3.0-12.el9 543 kB/s | 54 kB 00:00 2026-02-21T12:04:45.562 INFO:teuthology.orchestra.run.trial058.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 423 kB/s | 42 kB 00:00 2026-02-21T12:04:45.662 INFO:teuthology.orchestra.run.trial058.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.9 MB/s | 189 kB 00:00 2026-02-21T12:04:45.761 INFO:teuthology.orchestra.run.trial058.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 913 kB/s | 90 kB 00:00 2026-02-21T12:04:45.790 INFO:teuthology.orchestra.run.trial058.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 771 kB/s | 22 kB 00:00 2026-02-21T12:04:45.847 INFO:teuthology.orchestra.run.trial058.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 15 MB/s | 862 kB 00:00 2026-02-21T12:04:45.922 INFO:teuthology.orchestra.run.trial058.stdout:(57/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 37 MB/s | 19 MB 00:00 2026-02-21T12:04:46.172 INFO:teuthology.orchestra.run.trial058.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2026-02-21T12:04:46.365 INFO:teuthology.orchestra.run.trial058.stdout:(59/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.0 MB/s | 551 kB 00:00 2026-02-21T12:04:46.381 INFO:teuthology.orchestra.run.trial058.stdout:(60/96): luarocks-3.9.2-5.el9.noarch.rpm 720 kB/s | 151 kB 00:00 2026-02-21T12:04:46.449 INFO:teuthology.orchestra.run.trial058.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 434 kB/s | 29 kB 00:00 2026-02-21T12:04:46.467 INFO:teuthology.orchestra.run.trial058.stdout:(62/96): python3-asyncssh-2.13.2-5.el9.noarch.r 5.2 MB/s | 548 kB 00:00 2026-02-21T12:04:46.477 INFO:teuthology.orchestra.run.trial058.stdout:(63/96): python3-babel-2.9.1-2.el9.noarch.rpm 2.2 MB/s | 6.0 MB 00:02 2026-02-21T12:04:46.525 INFO:teuthology.orchestra.run.trial058.stdout:(64/96): python3-backports-tarfile-1.2.0-1.el9. 793 kB/s | 60 kB 00:00 2026-02-21T12:04:46.530 INFO:teuthology.orchestra.run.trial058.stdout:(65/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 686 kB/s | 43 kB 00:00 2026-02-21T12:04:46.590 INFO:teuthology.orchestra.run.trial058.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 220 kB/s | 14 kB 00:00 2026-02-21T12:04:46.602 INFO:teuthology.orchestra.run.trial058.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 2.4 MB/s | 173 kB 00:00 2026-02-21T12:04:46.679 INFO:teuthology.orchestra.run.trial058.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 3.2 MB/s | 254 kB 00:00 2026-02-21T12:04:46.741 INFO:teuthology.orchestra.run.trial058.stdout:(69/96): python3-cherrypy-18.6.1-2.el9.noarch.r 2.3 MB/s | 358 kB 00:00 2026-02-21T12:04:46.815 INFO:teuthology.orchestra.run.trial058.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 1.9 MB/s | 144 kB 00:00 2026-02-21T12:04:46.825 INFO:teuthology.orchestra.run.trial058.stdout:(71/96): python3-cachetools-4.2.4-1.el9.noarch. 92 kB/s | 32 kB 00:00 2026-02-21T12:04:46.865 INFO:teuthology.orchestra.run.trial058.stdout:(72/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2026-02-21T12:04:46.887 INFO:teuthology.orchestra.run.trial058.stdout:(73/96): python3-influxdb-5.3.1-1.el9.noarch.rp 1.9 MB/s | 139 kB 00:00 2026-02-21T12:04:46.926 INFO:teuthology.orchestra.run.trial058.stdout:(74/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 175 kB/s | 11 kB 00:00 2026-02-21T12:04:46.949 INFO:teuthology.orchestra.run.trial058.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 287 kB/s | 18 kB 00:00 2026-02-21T12:04:46.984 INFO:teuthology.orchestra.run.trial058.stdout:(76/96): python3-isodate-0.6.1-3.el9.noarch.rpm 351 kB/s | 56 kB 00:00 2026-02-21T12:04:46.987 INFO:teuthology.orchestra.run.trial058.stdout:(77/96): python3-jaraco-collections-3.0.0-8.el9 378 kB/s | 23 kB 00:00 2026-02-21T12:04:47.011 INFO:teuthology.orchestra.run.trial058.stdout:(78/96): python3-jaraco-context-6.0.1-3.el9.noa 315 kB/s | 20 kB 00:00 2026-02-21T12:04:47.049 INFO:teuthology.orchestra.run.trial058.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 431 kB/s | 26 kB 00:00 2026-02-21T12:04:47.072 INFO:teuthology.orchestra.run.trial058.stdout:(80/96): python3-jaraco-functools-3.5.0-2.el9.n 221 kB/s | 19 kB 00:00 2026-02-21T12:04:47.111 INFO:teuthology.orchestra.run.trial058.stdout:(81/96): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2026-02-21T12:04:47.165 INFO:teuthology.orchestra.run.trial058.stdout:(82/96): python3-kubernetes-26.1.0-3.el9.noarch 6.6 MB/s | 1.0 MB 00:00 2026-02-21T12:04:47.172 INFO:teuthology.orchestra.run.trial058.stdout:(83/96): python3-natsort-7.1.1-5.el9.noarch.rpm 940 kB/s | 58 kB 00:00 2026-02-21T12:04:47.195 INFO:teuthology.orchestra.run.trial058.stdout:(84/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 697 kB/s | 86 kB 00:00 2026-02-21T12:04:47.227 INFO:teuthology.orchestra.run.trial058.stdout:(85/96): python3-portend-3.1.0-2.el9.noarch.rpm 268 kB/s | 16 kB 00:00 2026-02-21T12:04:47.235 INFO:teuthology.orchestra.run.trial058.stdout:(86/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.4 MB/s | 90 kB 00:00 2026-02-21T12:04:47.289 INFO:teuthology.orchestra.run.trial058.stdout:(87/96): python3-repoze-lru-0.7-16.el9.noarch.r 330 kB/s | 31 kB 00:00 2026-02-21T12:04:47.293 INFO:teuthology.orchestra.run.trial058.stdout:(88/96): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2026-02-21T12:04:47.296 INFO:teuthology.orchestra.run.trial058.stdout:(89/96): python3-rsa-4.9-2.el9.noarch.rpm 963 kB/s | 59 kB 00:00 2026-02-21T12:04:47.355 INFO:teuthology.orchestra.run.trial058.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 584 kB/s | 36 kB 00:00 2026-02-21T12:04:47.359 INFO:teuthology.orchestra.run.trial058.stdout:(91/96): python3-typing-extensions-4.15.0-1.el9 1.4 MB/s | 86 kB 00:00 2026-02-21T12:04:47.418 INFO:teuthology.orchestra.run.trial058.stdout:(92/96): python3-websocket-client-1.2.3-2.el9.n 1.4 MB/s | 90 kB 00:00 2026-02-21T12:04:47.420 INFO:teuthology.orchestra.run.trial058.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 790 kB/s | 48 kB 00:00 2026-02-21T12:04:47.429 INFO:teuthology.orchestra.run.trial058.stdout:(94/96): python3-saml-1.16.0-1.el9.noarch.rpm 892 kB/s | 125 kB 00:00 2026-02-21T12:04:47.481 INFO:teuthology.orchestra.run.trial058.stdout:(95/96): python3-xmltodict-0.12.0-15.el9.noarch 353 kB/s | 22 kB 00:00 2026-02-21T12:04:47.483 INFO:teuthology.orchestra.run.trial058.stdout:(96/96): python3-zc-lockfile-2.0-10.el9.noarch. 320 kB/s | 20 kB 00:00 2026-02-21T12:04:47.488 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-21T12:04:47.488 INFO:teuthology.orchestra.run.trial058.stdout:Total 9.9 MB/s | 158 MB 00:16 2026-02-21T12:04:47.894 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-21T12:04:47.934 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-21T12:04:47.934 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-21T12:04:48.538 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-21T12:04:48.538 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-21T12:04:49.180 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-21T12:04:49.181 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-21T12:04:49.185 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-21T12:04:49.207 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-21T12:04:49.242 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-21T12:04:49.248 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-21T12:04:49.250 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-21T12:04:49.254 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-21T12:04:49.278 INFO:teuthology.orchestra.run.trial058.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-21T12:04:49.291 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-21T12:04:49.294 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-21T12:04:49.300 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-21T12:04:49.301 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-21T12:04:49.313 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-21T12:04:49.319 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-21T12:04:49.344 INFO:teuthology.orchestra.run.trial058.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-21T12:04:49.347 INFO:teuthology.orchestra.run.trial058.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-21T12:04:49.399 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-21T12:04:49.412 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-21T12:04:49.415 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-21T12:04:49.419 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-21T12:04:49.425 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-21T12:04:49.430 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-21T12:04:49.433 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-21T12:04:49.448 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-21T12:04:49.452 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-21T12:04:49.457 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-21T12:04:49.468 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-21T12:04:49.477 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-21T12:04:49.484 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-21T12:04:49.504 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-21T12:04:49.515 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-21T12:04:49.531 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-21T12:04:49.535 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-21T12:04:49.543 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-21T12:04:49.584 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-21T12:04:49.912 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-21T12:04:49.922 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-21T12:04:49.925 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-21T12:04:49.931 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-21T12:04:49.933 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-21T12:04:49.960 INFO:teuthology.orchestra.run.trial058.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-21T12:04:50.005 INFO:teuthology.orchestra.run.trial058.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-21T12:04:50.014 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-21T12:04:50.019 INFO:teuthology.orchestra.run.trial058.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-21T12:04:50.023 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-21T12:04:50.028 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-21T12:04:50.032 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-21T12:04:50.039 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-21T12:04:50.043 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-21T12:04:50.071 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-21T12:04:50.081 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-21T12:04:50.087 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-21T12:04:50.094 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-21T12:04:50.129 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-21T12:04:50.356 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-21T12:04:50.380 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-21T12:04:50.384 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-21T12:04:50.442 INFO:teuthology.orchestra.run.trial058.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-21T12:04:50.444 INFO:teuthology.orchestra.run.trial058.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-21T12:04:50.465 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-21T12:04:50.794 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-21T12:04:50.868 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-21T12:04:51.546 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-21T12:04:51.563 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-21T12:04:51.573 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-21T12:04:51.580 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-21T12:04:51.593 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-21T12:04:51.609 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-21T12:04:51.685 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-21T12:04:51.694 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-21T12:04:51.718 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-21T12:04:51.748 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-21T12:04:51.800 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-21T12:04:51.806 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-21T12:04:51.809 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-21T12:04:51.810 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-21T12:04:51.830 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-21T12:04:51.830 INFO:teuthology.orchestra.run.trial058.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-21T12:04:51.830 INFO:teuthology.orchestra.run.trial058.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-21T12:04:51.830 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:51.839 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-21T12:04:51.865 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-21T12:04:51.866 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-21T12:04:51.866 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:51.901 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-21T12:04:52.522 INFO:teuthology.orchestra.run.trial058.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-21T12:04:53.284 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-classic-2:20.3.0-5397.gf7273f30.el9.x86_6 80/96 2026-02-21T12:04:53.348 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-crimson-2:20.3.0-5397.gf7273f30.el9.x86_6 81/96 2026-02-21T12:04:53.350 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-volume-2:20.3.0-5397.gf7273f30.el9.noarch 82/96 2026-02-21T12:04:53.365 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-volume-2:20.3.0-5397.gf7273f30.el9.noarch 82/96 2026-02-21T12:04:53.365 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T12:04:53.365 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-21T12:04:53.365 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:53.375 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-2:20.3.0-5397.gf7273f30.el9.x86_64 83/96 2026-02-21T12:04:53.399 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-2:20.3.0-5397.gf7273f30.el9.x86_64 83/96 2026-02-21T12:04:53.399 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T12:04:53.399 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-21T12:04:53.399 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-21T12:04:53.399 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-21T12:04:53.399 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:53.457 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: cephadm-2:20.3.0-5397.gf7273f30.el9.noarch 84/96 2026-02-21T12:04:53.459 INFO:teuthology.orchestra.run.trial058.stdout: Installing : cephadm-2:20.3.0-5397.gf7273f30.el9.noarch 84/96 2026-02-21T12:04:53.468 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5397.gf7273f30.el9 85/96 2026-02-21T12:04:53.493 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5397.gf7273f30.el 86/96 2026-02-21T12:04:53.494 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5397.gf7273f30.el9.noarc 87/96 2026-02-21T12:04:56.397 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5397.gf7273f30.el9.noarc 87/96 2026-02-21T12:04:56.404 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5397.gf7273f30.el9.noa 88/96 2026-02-21T12:04:56.859 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5397.gf7273f30.el9.noa 88/96 2026-02-21T12:04:56.860 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5397.gf7273 89/96 2026-02-21T12:04:56.872 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5397.gf7273 89/96 2026-02-21T12:04:56.873 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5397.gf7273f30.el9.noa 90/96 2026-02-21T12:04:56.935 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5397.gf7273f30.el9.noa 90/96 2026-02-21T12:04:56.976 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5397.gf7273f30.el9. 91/96 2026-02-21T12:04:56.978 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-2:20.3.0-5397.gf7273f30.el9.x86_64 92/96 2026-02-21T12:04:56.999 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5397.gf7273f30.el9.x86_64 92/96 2026-02-21T12:04:56.999 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T12:04:56.999 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-21T12:04:56.999 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-21T12:04:56.999 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-21T12:04:56.999 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:57.010 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-rook-2:20.3.0-5397.gf7273f30.el9.noarch 93/96 2026-02-21T12:04:57.234 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5397.gf7273f30.el9.noarch 93/96 2026-02-21T12:04:57.235 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mon-2:20.3.0-5397.gf7273f30.el9.x86_64 94/96 2026-02-21T12:04:57.257 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mon-2:20.3.0-5397.gf7273f30.el9.x86_64 94/96 2026-02-21T12:04:57.257 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T12:04:57.257 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-21T12:04:57.257 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-21T12:04:57.257 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-21T12:04:57.257 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:57.352 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mds-2:20.3.0-5397.gf7273f30.el9.x86_64 95/96 2026-02-21T12:04:57.373 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mds-2:20.3.0-5397.gf7273f30.el9.x86_64 95/96 2026-02-21T12:04:57.373 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T12:04:57.373 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-21T12:04:57.373 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-21T12:04:57.373 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-21T12:04:57.373 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:57.373 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-2:20.3.0-5397.gf7273f30.el9.x86_64 96/96 2026-02-21T12:04:57.380 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5397.gf7273f30.el9.x86_6 96/96 2026-02-21T12:04:57.405 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5397.gf7273f30.el9.x86_6 96/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-2:20.3.0-5397.gf7273f30.el9.x86_64 96/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-2:20.3.0-5397.gf7273f30.el9.x86_64 1/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mds-2:20.3.0-5397.gf7273f30.el9.x86_64 2/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-2:20.3.0-5397.gf7273f30.el9.x86_64 3/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mon-2:20.3.0-5397.gf7273f30.el9.x86_64 4/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-2:20.3.0-5397.gf7273f30.el9.x86_64 5/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-classic-2:20.3.0-5397.gf7273f30.el9.x86_6 6/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5397.gf7273f30.el9.x86_6 7/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5397.gf7273f30.el 8/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5397.gf7273f30.el9.noarc 9/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5397.gf7273f30.el9.noa 10/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5397.gf7273 11/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5397.gf7273f30.el9.noa 12/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5397.gf7273f30.el9. 13/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5397.gf7273f30.el9.noarch 14/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5397.gf7273f30.el9 15/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-volume-2:20.3.0-5397.gf7273f30.el9.noarch 16/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : cephadm-2:20.3.0-5397.gf7273f30.el9.noarch 17/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-21T12:04:58.221 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-21T12:04:58.222 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-21T12:04:58.223 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-21T12:04:58.224 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-21T12:04:58.288 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-21T12:04:58.288 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-grafana-dashboards-2:20.3.0-5397.gf7273f30.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mds-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-cephadm-2:20.3.0-5397.gf7273f30.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-dashboard-2:20.3.0-5397.gf7273f30.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5397.gf7273f30.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-k8sevents-2:20.3.0-5397.gf7273f30.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-modules-core-2:20.3.0-5397.gf7273f30.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-rook-2:20.3.0-5397.gf7273f30.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mon-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-classic-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-crimson-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-prometheus-alerts-2:20.3.0-5397.gf7273f30.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ceph-volume-2:20.3.0-5397.gf7273f30.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: cephadm-2:20.3.0-5397.gf7273f30.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: lua-5.4.4-4.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-21T12:04:58.289 INFO:teuthology.orchestra.run.trial058.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-ply-3.11-14.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-21T12:04:58.290 INFO:teuthology.orchestra.run.trial058.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout: unzip-6.0-59.el9.x86_64 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout: zip-3.0-35.el9.x86_64 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:58.291 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:04:58.351 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-base 2026-02-21T12:04:58.660 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:51 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:04:58.725 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-base-2:20.3.0-5397.gf7273f30.el9.x86_64 is already installed. 2026-02-21T12:04:58.743 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:04:58.744 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:04:58.744 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:04:58.766 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install cephadm 2026-02-21T12:04:59.073 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:04:59.139 INFO:teuthology.orchestra.run.trial058.stdout:Package cephadm-2:20.3.0-5397.gf7273f30.el9.noarch is already installed. 2026-02-21T12:04:59.158 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:04:59.159 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:04:59.159 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:04:59.179 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-immutable-object-cache 2026-02-21T12:04:59.483 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:04:59.565 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:04:59.565 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:04:59.566 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repo Size 2026-02-21T12:04:59.566 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:04:59.566 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-21T12:04:59.566 INFO:teuthology.orchestra.run.trial058.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 147 k 2026-02-21T12:04:59.566 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:59.566 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-21T12:04:59.566 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:04:59.566 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-21T12:04:59.566 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:04:59.566 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 147 k 2026-02-21T12:04:59.566 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 419 k 2026-02-21T12:04:59.566 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-21T12:04:59.930 INFO:teuthology.orchestra.run.trial058.stdout:ceph-immutable-object-cache-20.3.0-5397.gf7273f 404 kB/s | 147 kB 00:00 2026-02-21T12:04:59.932 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-21T12:04:59.932 INFO:teuthology.orchestra.run.trial058.stdout:Total 401 kB/s | 147 kB 00:00 2026-02-21T12:04:59.932 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-21T12:04:59.937 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-21T12:04:59.937 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-21T12:04:59.969 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-21T12:04:59.969 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-21T12:05:00.025 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-21T12:05:00.026 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5397.gf7273f30. 1/1 2026-02-21T12:05:00.048 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5397.gf7273f30. 1/1 2026-02-21T12:05:00.048 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T12:05:00.048 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-21T12:05:00.049 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:00.364 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5397.gf7273f30. 1/1 2026-02-21T12:05:00.364 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:00.365 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-21T12:05:00.365 INFO:teuthology.orchestra.run.trial058.stdout: ceph-immutable-object-cache-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:05:00.365 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:00.365 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:00.392 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr 2026-02-21T12:05:00.704 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:00.769 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-2:20.3.0-5397.gf7273f30.el9.x86_64 is already installed. 2026-02-21T12:05:00.787 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:00.788 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:00.788 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:00.809 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr-dashboard 2026-02-21T12:05:01.120 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:54 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:01.184 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-dashboard-2:20.3.0-5397.gf7273f30.el9.noarch is already installed. 2026-02-21T12:05:01.202 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:01.203 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:01.204 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:01.224 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-21T12:05:01.533 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:54 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:01.597 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5397.gf7273f30.el9.noarch is already installed. 2026-02-21T12:05:01.615 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:01.616 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:01.617 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:01.636 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr-rook 2026-02-21T12:05:01.945 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:54 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:02.011 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-rook-2:20.3.0-5397.gf7273f30.el9.noarch is already installed. 2026-02-21T12:05:02.029 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:02.030 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:02.030 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:02.051 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-mgr-cephadm 2026-02-21T12:05:02.358 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:02.422 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-cephadm-2:20.3.0-5397.gf7273f30.el9.noarch is already installed. 2026-02-21T12:05:02.441 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:02.441 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:02.441 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:02.462 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-osd 2026-02-21T12:05:02.765 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:02.832 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-osd-2:20.3.0-5397.gf7273f30.el9.x86_64 is already installed. 2026-02-21T12:05:02.850 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:02.850 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:02.851 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:02.871 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-osd-classic 2026-02-21T12:05:03.182 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:03.247 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-osd-classic-2:20.3.0-5397.gf7273f30.el9.x86_64 is already installed. 2026-02-21T12:05:03.265 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:03.266 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:03.266 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:03.287 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-fuse 2026-02-21T12:05:03.599 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:03.682 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repo Size 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout: ceph-fuse x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 988 k 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 988 k 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 2.9 M 2026-02-21T12:05:03.683 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-21T12:05:03.803 INFO:teuthology.orchestra.run.trial058.stdout:ceph-fuse-20.3.0-5397.gf7273f30.el9.x86_64.rpm 8.1 MB/s | 988 kB 00:00 2026-02-21T12:05:03.803 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-21T12:05:03.804 INFO:teuthology.orchestra.run.trial058.stdout:Total 8.0 MB/s | 988 kB 00:00 2026-02-21T12:05:03.805 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-21T12:05:03.808 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-21T12:05:03.809 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-21T12:05:03.843 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-21T12:05:03.843 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-21T12:05:03.937 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-21T12:05:03.954 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-fuse-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:04.184 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:04.241 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-fuse-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:04.241 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:04.241 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-21T12:05:04.242 INFO:teuthology.orchestra.run.trial058.stdout: ceph-fuse-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:05:04.242 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:04.242 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:04.266 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-volume 2026-02-21T12:05:04.580 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:57 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:04.644 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-volume-2:20.3.0-5397.gf7273f30.el9.noarch is already installed. 2026-02-21T12:05:04.662 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:04.662 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:04.663 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:04.683 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install librados-devel 2026-02-21T12:05:04.993 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:05.076 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:05.076 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:05.076 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repo Size 2026-02-21T12:05:05.076 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:05.076 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-21T12:05:05.076 INFO:teuthology.orchestra.run.trial058.stdout: librados-devel x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 123 k 2026-02-21T12:05:05.076 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:05.076 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-21T12:05:05.077 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:05.077 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-21T12:05:05.077 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:05.077 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 123 k 2026-02-21T12:05:05.077 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 437 k 2026-02-21T12:05:05.077 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-21T12:05:05.163 INFO:teuthology.orchestra.run.trial058.stdout:librados-devel-20.3.0-5397.gf7273f30.el9.x86_64 1.4 MB/s | 123 kB 00:00 2026-02-21T12:05:05.163 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-21T12:05:05.163 INFO:teuthology.orchestra.run.trial058.stdout:Total 1.4 MB/s | 123 kB 00:00 2026-02-21T12:05:05.163 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-21T12:05:05.166 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-21T12:05:05.166 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-21T12:05:05.197 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-21T12:05:05.197 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-21T12:05:05.252 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-21T12:05:05.268 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librados-devel-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:05.347 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librados-devel-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:05.404 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librados-devel-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:05.405 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:05.405 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-21T12:05:05.405 INFO:teuthology.orchestra.run.trial058.stdout: librados-devel-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:05:05.405 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:05.405 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:05.433 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install libcephfs2 2026-02-21T12:05:05.745 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:05.809 INFO:teuthology.orchestra.run.trial058.stdout:Package libcephfs2-2:20.3.0-5397.gf7273f30.el9.x86_64 is already installed. 2026-02-21T12:05:05.827 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:05.828 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:05.828 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:05.849 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install libcephfs-devel 2026-02-21T12:05:06.159 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:06.243 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:06.243 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:06.243 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repo Size 2026-02-21T12:05:06.243 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:06.243 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-21T12:05:06.243 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-devel x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 37 k 2026-02-21T12:05:06.243 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:06.243 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-21T12:05:06.244 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:06.244 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-21T12:05:06.244 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:06.244 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 37 k 2026-02-21T12:05:06.244 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 171 k 2026-02-21T12:05:06.244 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-21T12:05:06.488 INFO:teuthology.orchestra.run.trial058.stdout:libcephfs-devel-20.3.0-5397.gf7273f30.el9.x86_6 152 kB/s | 37 kB 00:00 2026-02-21T12:05:06.488 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-21T12:05:06.488 INFO:teuthology.orchestra.run.trial058.stdout:Total 152 kB/s | 37 kB 00:00 2026-02-21T12:05:06.488 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-21T12:05:06.491 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-21T12:05:06.491 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-21T12:05:06.493 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-21T12:05:06.493 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-21T12:05:06.515 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-21T12:05:06.531 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs-devel-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:06.589 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:06.650 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs-devel-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:06.650 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:06.651 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-21T12:05:06.651 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-devel-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:05:06.651 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:06.651 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:06.677 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install librados2 2026-02-21T12:05:06.985 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:07.050 INFO:teuthology.orchestra.run.trial058.stdout:Package librados2-2:20.3.0-5397.gf7273f30.el9.x86_64 is already installed. 2026-02-21T12:05:07.068 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:07.069 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:07.069 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:07.091 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install librbd1 2026-02-21T12:05:07.398 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:07.462 INFO:teuthology.orchestra.run.trial058.stdout:Package librbd1-2:20.3.0-5397.gf7273f30.el9.x86_64 is already installed. 2026-02-21T12:05:07.480 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:07.481 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:07.481 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:07.502 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install python3-rados 2026-02-21T12:05:07.813 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:07.878 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-rados-2:20.3.0-5397.gf7273f30.el9.x86_64 is already installed. 2026-02-21T12:05:07.896 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:07.897 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:07.897 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:07.918 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install python3-rgw 2026-02-21T12:05:08.228 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:01 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:08.292 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-rgw-2:20.3.0-5397.gf7273f30.el9.x86_64 is already installed. 2026-02-21T12:05:08.310 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:08.311 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:08.311 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:08.333 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install python3-cephfs 2026-02-21T12:05:08.638 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:01 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:08.702 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-cephfs-2:20.3.0-5397.gf7273f30.el9.x86_64 is already installed. 2026-02-21T12:05:08.721 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:08.721 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:08.721 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:08.742 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install python3-rbd 2026-02-21T12:05:09.053 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:02 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:09.120 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-rbd-2:20.3.0-5397.gf7273f30.el9.x86_64 is already installed. 2026-02-21T12:05:09.139 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:09.139 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-21T12:05:09.140 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:09.162 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install rbd-fuse 2026-02-21T12:05:09.473 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:02 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:09.556 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:09.557 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:09.557 INFO:teuthology.orchestra.run.trial058.stdout: Package Architecture Version Repository Size 2026-02-21T12:05:09.557 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:09.557 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-21T12:05:09.557 INFO:teuthology.orchestra.run.trial058.stdout: rbd-fuse x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 84 k 2026-02-21T12:05:09.557 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:09.558 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-21T12:05:09.558 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:09.558 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-21T12:05:09.558 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:09.558 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 84 k 2026-02-21T12:05:09.559 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 209 k 2026-02-21T12:05:09.559 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-21T12:05:09.631 INFO:teuthology.orchestra.run.trial058.stdout:rbd-fuse-20.3.0-5397.gf7273f30.el9.x86_64.rpm 1.1 MB/s | 84 kB 00:00 2026-02-21T12:05:09.632 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-21T12:05:09.632 INFO:teuthology.orchestra.run.trial058.stdout:Total 1.1 MB/s | 84 kB 00:00 2026-02-21T12:05:09.632 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-21T12:05:09.635 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-21T12:05:09.635 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-21T12:05:09.667 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-21T12:05:09.667 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-21T12:05:09.718 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-21T12:05:09.735 INFO:teuthology.orchestra.run.trial058.stdout: Installing : rbd-fuse-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:09.816 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:09.873 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : rbd-fuse-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:09.874 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:09.874 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-21T12:05:09.874 INFO:teuthology.orchestra.run.trial058.stdout: rbd-fuse-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:05:09.874 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:09.874 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:09.902 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install rbd-mirror 2026-02-21T12:05:10.213 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:03 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:10.297 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:10.297 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:10.297 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repo Size 2026-02-21T12:05:10.297 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:10.297 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-21T12:05:10.298 INFO:teuthology.orchestra.run.trial058.stdout: rbd-mirror x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 2.9 M 2026-02-21T12:05:10.298 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:10.298 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-21T12:05:10.298 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:10.298 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-21T12:05:10.298 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:10.298 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 2.9 M 2026-02-21T12:05:10.298 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 11 M 2026-02-21T12:05:10.298 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-21T12:05:10.443 INFO:teuthology.orchestra.run.trial058.stdout:rbd-mirror-20.3.0-5397.gf7273f30.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-21T12:05:10.444 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-21T12:05:10.444 INFO:teuthology.orchestra.run.trial058.stdout:Total 19 MB/s | 2.9 MB 00:00 2026-02-21T12:05:10.444 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-21T12:05:10.448 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-21T12:05:10.449 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-21T12:05:10.488 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-21T12:05:10.488 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-21T12:05:10.665 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-21T12:05:10.666 INFO:teuthology.orchestra.run.trial058.stdout: Installing : rbd-mirror-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:10.690 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:10.690 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T12:05:10.690 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-21T12:05:10.690 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-21T12:05:10.690 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-21T12:05:10.690 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:10.979 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : rbd-mirror-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:10.979 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:10.979 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-21T12:05:10.979 INFO:teuthology.orchestra.run.trial058.stdout: rbd-mirror-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:05:10.980 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:10.980 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:11.006 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install rbd-nbd 2026-02-21T12:05:11.317 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:01:04 ago on Sat 21 Feb 2026 12:04:07 PM UTC. 2026-02-21T12:05:11.400 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-21T12:05:11.400 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:11.401 INFO:teuthology.orchestra.run.trial058.stdout: Package Architecture Version Repository Size 2026-02-21T12:05:11.401 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:11.401 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-21T12:05:11.401 INFO:teuthology.orchestra.run.trial058.stdout: rbd-nbd x86_64 2:20.3.0-5397.gf7273f30.el9 ceph 172 k 2026-02-21T12:05:11.401 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:11.401 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-21T12:05:11.401 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-21T12:05:11.401 INFO:teuthology.orchestra.run.trial058.stdout:Install 1 Package 2026-02-21T12:05:11.401 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:11.401 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 172 k 2026-02-21T12:05:11.401 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 462 k 2026-02-21T12:05:11.402 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-21T12:05:11.503 INFO:teuthology.orchestra.run.trial058.stdout:rbd-nbd-20.3.0-5397.gf7273f30.el9.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2026-02-21T12:05:11.503 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-21T12:05:11.504 INFO:teuthology.orchestra.run.trial058.stdout:Total 1.6 MB/s | 172 kB 00:00 2026-02-21T12:05:11.504 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-21T12:05:11.508 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-21T12:05:11.508 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-21T12:05:11.539 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-21T12:05:11.539 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-21T12:05:11.595 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-21T12:05:11.612 INFO:teuthology.orchestra.run.trial058.stdout: Installing : rbd-nbd-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:11.694 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:11.752 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : rbd-nbd-2:20.3.0-5397.gf7273f30.el9.x86_64 1/1 2026-02-21T12:05:11.752 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:11.752 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-21T12:05:11.752 INFO:teuthology.orchestra.run.trial058.stdout: rbd-nbd-2:20.3.0-5397.gf7273f30.el9.x86_64 2026-02-21T12:05:11.752 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-21T12:05:11.752 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-21T12:05:11.784 DEBUG:teuthology.parallel:result is None 2026-02-21T12:05:11.784 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7273f3049146bdd7fa7b4a400114872a50228e9 2026-02-21T12:05:11.949 DEBUG:teuthology.orchestra.run.trial058:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-21T12:05:11.970 INFO:teuthology.orchestra.run.trial058.stdout:20.3.0-5397.gf7273f30.el9 2026-02-21T12:05:11.971 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5397.gf7273f30.el9 2026-02-21T12:05:11.971 INFO:teuthology.task.install:The correct ceph version 20.3.0-5397.gf7273f30 is installed. 2026-02-21T12:05:11.973 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-21T12:05:11.973 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-21T12:05:11.973 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-21T12:05:12.035 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-21T12:05:12.036 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-21T12:05:12.036 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/usr/bin/daemon-helper 2026-02-21T12:05:12.100 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-21T12:05:12.164 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-21T12:05:12.165 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-21T12:05:12.165 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-21T12:05:12.228 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-21T12:05:12.292 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-21T12:05:12.293 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-21T12:05:12.293 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/usr/bin/stdin-killer 2026-02-21T12:05:12.357 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-21T12:05:12.423 INFO:teuthology.run_tasks:Running task workunit... 2026-02-21T12:05:12.451 INFO:tasks.workunit:Pulling workunits from ref f7273f3049146bdd7fa7b4a400114872a50228e9 2026-02-21T12:05:12.452 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-21T12:05:12.452 INFO:tasks.workunit:timeout=3h 2026-02-21T12:05:12.452 INFO:tasks.workunit:cleanup=True 2026-02-21T12:05:12.453 DEBUG:teuthology.orchestra.run.trial058:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-21T12:05:12.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T12:05:12.480 INFO:teuthology.orchestra.run.trial058.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-21T12:05:12.481 DEBUG:teuthology.orchestra.run.trial058:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-21T12:05:12.537 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-21T12:05:12.538 DEBUG:teuthology.orchestra.run.trial058:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-21T12:05:12.595 DEBUG:teuthology.orchestra.run.trial058:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f7273f3049146bdd7fa7b4a400114872a50228e9 2026-02-21T12:05:12.657 INFO:tasks.workunit.client.0.trial058.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr:Note: switching to 'f7273f3049146bdd7fa7b4a400114872a50228e9'. 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr:state without impacting any branches by switching back to a branch. 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr: git switch -c 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr:Or undo this operation with: 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr: git switch - 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-21T12:05:32.301 INFO:tasks.workunit.client.0.trial058.stderr:HEAD is now at f7273f30491 Merge branch 'fs_mirror_daemon_status' of https://github.com/kotreshhr/ceph into wip-bharath21-testing-2026-02-20-1039 2026-02-21T12:05:32.308 DEBUG:teuthology.orchestra.run.trial058:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-21T12:05:32.368 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-21T12:05:32.368 DEBUG:teuthology.orchestra.run.trial058:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-21T12:05:32.425 INFO:tasks.workunit:Running workunits matching osd on client.0... 2026-02-21T12:05:32.427 INFO:tasks.workunit:Running workunit osd/bad-inc-map.sh... 2026-02-21T12:05:32.427 DEBUG:teuthology.orchestra.run.trial058:workunit test osd/bad-inc-map.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f7273f3049146bdd7fa7b4a400114872a50228e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2026-02-21T12:05:32.488 INFO:tasks.workunit.client.0.trial058.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-21T12:05:32.506 INFO:tasks.workunit.client.0.trial058.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-21T12:05:32.506 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2422: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-21T12:05:32.506 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2422: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-21T12:05:32.506 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: main: export PYTHONWARNINGS=ignore 2026-02-21T12:05:32.506 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: main: PYTHONWARNINGS=ignore 2026-02-21T12:05:32.506 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2424: main: export CEPH_CONF=/dev/null 2026-02-21T12:05:32.506 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2424: main: CEPH_CONF=/dev/null 2026-02-21T12:05:32.506 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2425: main: unset CEPH_ARGS 2026-02-21T12:05:32.506 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: main: local code 2026-02-21T12:05:32.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2428: main: run td/bad-inc-map 2026-02-21T12:05:32.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:8: run: local dir=td/bad-inc-map 2026-02-21T12:05:32.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:9: run: shift 2026-02-21T12:05:32.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: export CEPH_MON=127.0.0.1:44503 2026-02-21T12:05:32.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: CEPH_MON=127.0.0.1:44503 2026-02-21T12:05:32.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:12: run: export CEPH_ARGS 2026-02-21T12:05:32.507 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: uuidgen 2026-02-21T12:05:32.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: CEPH_ARGS+='--fsid=95085676-fa59-4f5b-a8b1-b5be89008247 --auth-supported=none ' 2026-02-21T12:05:32.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:44503 ' 2026-02-21T12:05:32.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:15: run: set -e 2026-02-21T12:05:32.507 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: set 2026-02-21T12:05:32.508 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-21T12:05:32.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: local funcs=TEST_bad_inc_map 2026-02-21T12:05:32.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:18: run: for func in $funcs 2026-02-21T12:05:32.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:19: run: setup td/bad-inc-map 2026-02-21T12:05:32.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/bad-inc-map 2026-02-21T12:05:32.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/bad-inc-map 2026-02-21T12:05:32.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-21T12:05:32.510 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:05:32.510 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-21T12:05:32.510 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:05:32.510 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:05:32.510 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:05:32.510 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:05:32.510 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:05:32.511 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:05:32.511 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:05:32.512 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:05:32.512 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:05:32.513 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:05:32.513 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:05:32.513 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:05:32.514 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:05:32.514 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:05:32.514 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:05:32.514 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:05:32.515 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:05:32.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:05:32.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-21T12:05:32.517 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:05:32.517 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:32.517 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37612 2026-02-21T12:05:32.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.37612 2026-02-21T12:05:32.518 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:05:32.518 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:05:32.518 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/bad-inc-map 2026-02-21T12:05:32.519 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-21T12:05:32.519 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:32.519 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37612 2026-02-21T12:05:32.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.37612 2026-02-21T12:05:32.520 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-21T12:05:32.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-21T12:05:32.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-21T12:05:32.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-21T12:05:32.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/bad-inc-map 1' TERM HUP INT 2026-02-21T12:05:32.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:20: run: TEST_bad_inc_map td/bad-inc-map 2026-02-21T12:05:32.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:26: TEST_bad_inc_map: local dir=td/bad-inc-map 2026-02-21T12:05:32.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:28: TEST_bad_inc_map: run_mon td/bad-inc-map a 2026-02-21T12:05:32.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/bad-inc-map 2026-02-21T12:05:32.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-21T12:05:32.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-21T12:05:32.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-21T12:05:32.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/bad-inc-map/a 2026-02-21T12:05:32.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/bad-inc-map/a --run-dir=td/bad-inc-map 2026-02-21T12:05:32.548 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-21T12:05:32.548 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:05:32.548 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:05:32.548 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:05:32.548 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:32.548 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37612 2026-02-21T12:05:32.549 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37612/$cluster-$name.asok' 2026-02-21T12:05:32.549 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/bad-inc-map/a '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.37612/$cluster-$name.asok' --mon-cluster-log-file=td/bad-inc-map/log --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-21T12:05:32.570 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-21T12:05:32.572 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-21T12:05:32.572 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:05:32.573 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:05:32.573 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-21T12:05:32.573 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-21T12:05:32.573 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:05:32.573 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:05:32.573 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:05:32.573 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:05:32.573 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:32.573 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37612 2026-02-21T12:05:32.573 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.37612/ceph-mon.a.asok 2026-02-21T12:05:32.573 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:05:32.573 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.37612/ceph-mon.a.asok config get fsid 2026-02-21T12:05:32.616 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-21T12:05:32.616 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:05:32.616 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:05:32.616 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-21T12:05:32.616 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-21T12:05:32.616 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:05:32.616 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:05:32.616 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:05:32.616 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:05:32.616 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:32.617 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37612 2026-02-21T12:05:32.617 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.37612/ceph-mon.a.asok 2026-02-21T12:05:32.617 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:05:32.617 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.37612/ceph-mon.a.asok config get mon_host 2026-02-21T12:05:32.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:29: TEST_bad_inc_map: run_mgr td/bad-inc-map x 2026-02-21T12:05:32.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/bad-inc-map 2026-02-21T12:05:32.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-21T12:05:32.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-21T12:05:32.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-21T12:05:32.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/bad-inc-map/x 2026-02-21T12:05:32.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-21T12:05:32.756 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-21T12:05:32.756 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:05:32.756 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:05:32.756 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:05:32.756 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:32.756 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37612 2026-02-21T12:05:32.756 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37612/$cluster-$name.asok' 2026-02-21T12:05:32.756 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:05:32.757 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/bad-inc-map/x '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.37612/$cluster-$name.asok' --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:30: TEST_bad_inc_map: run_osd td/bad-inc-map 0 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/0 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=95085676-fa59-4f5b-a8b1-b5be89008247 --auth-supported=none --mon-host=127.0.0.1:44503 ' 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/0' 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/0/journal' 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:05:32.772 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37612 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37612/$cluster-$name.asok' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37612/$cluster-$name.asok' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/0 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d8d04ea3-6b94-4cea-8fdc-e1f986730234 2026-02-21T12:05:32.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d8d04ea3-6b94-4cea-8fdc-e1f986730234' 2026-02-21T12:05:32.774 INFO:tasks.workunit.client.0.trial058.stdout:add osd0 d8d04ea3-6b94-4cea-8fdc-e1f986730234 2026-02-21T12:05:32.774 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:05:32.782 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCMn5lpj23fLxAAvaCnitRebrLiEkUJ2XcEiw== 2026-02-21T12:05:32.782 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCMn5lpj23fLxAAvaCnitRebrLiEkUJ2XcEiw=="}' 2026-02-21T12:05:32.782 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d8d04ea3-6b94-4cea-8fdc-e1f986730234 -i td/bad-inc-map/0/new.json 2026-02-21T12:05:32.882 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:05:32.888 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/0/new.json 2026-02-21T12:05:32.889 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=95085676-fa59-4f5b-a8b1-b5be89008247 --auth-supported=none --mon-host=127.0.0.1:44503 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.37612/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCMn5lpj23fLxAAvaCnitRebrLiEkUJ2XcEiw== --osd-uuid d8d04ea3-6b94-4cea-8fdc-e1f986730234 2026-02-21T12:05:32.904 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:32.924+0000 7f1c28a2b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:32.905 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:32.925+0000 7f1c28a2b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:32.906 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:32.926+0000 7f1c28a2b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:32.906 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:32.926+0000 7f1c28a2b780 -1 bdev(0x3d8ac00 td/bad-inc-map/0/block) open stat got: (1) Operation not permitted 2026-02-21T12:05:32.906 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:32.926+0000 7f1c28a2b780 -1 bluestore(td/bad-inc-map/0) _read_fsid unparsable uuid 2026-02-21T12:05:33.342 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/0/keyring 2026-02-21T12:05:33.342 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:05:33.342 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-21T12:05:33.343 INFO:tasks.workunit.client.0.trial058.stdout:adding osd0 key to auth repository 2026-02-21T12:05:33.343 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:05:33.442 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:05:33.443 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-21T12:05:33.443 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=95085676-fa59-4f5b-a8b1-b5be89008247 --auth-supported=none --mon-host=127.0.0.1:44503 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.37612/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:05:33.443 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:05:33.443 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:05:33.443 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:05:33.457 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:33.476+0000 7f786fe85780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:33.458 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:33.478+0000 7f786fe85780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:33.459 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:33.479+0000 7f786fe85780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:33.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-21T12:05:33.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:05:33.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:05:33.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:05:33.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:05:33.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:05:33.542 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:05:33.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:05:33.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:33.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:05:33.636 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:05:33.668 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:33.687+0000 7f786fe85780 -1 Falling back to public interface 2026-02-21T12:05:33.975 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:33.994+0000 7f786fe85780 -1 osd.0 0 log_to_monitors true 2026-02-21T12:05:34.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:05:34.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:05:34.637 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:05:34.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:05:34.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:34.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:05:34.733 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1702889615,v1:127.0.0.1:6801/1702889615] [v2:127.0.0.1:6802/1702889615,v1:127.0.0.1:6803/1702889615] exists,up d8d04ea3-6b94-4cea-8fdc-e1f986730234 2026-02-21T12:05:34.734 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:05:34.734 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:05:34.734 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:05:34.734 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:31: TEST_bad_inc_map: run_osd td/bad-inc-map 1 2026-02-21T12:05:34.734 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-21T12:05:34.734 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:05:34.734 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-21T12:05:34.734 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/1 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=95085676-fa59-4f5b-a8b1-b5be89008247 --auth-supported=none --mon-host=127.0.0.1:44503 ' 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/1' 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/1/journal' 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:34.735 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37612 2026-02-21T12:05:34.737 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37612/$cluster-$name.asok' 2026-02-21T12:05:34.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37612/$cluster-$name.asok' 2026-02-21T12:05:34.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:05:34.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:05:34.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:05:34.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-21T12:05:34.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-21T12:05:34.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:05:34.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:05:34.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:05:34.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:05:34.738 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:05:34.738 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:05:34.738 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/1 2026-02-21T12:05:34.738 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:05:34.738 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=15f3da95-ea91-4620-a05e-2bffbaac422d 2026-02-21T12:05:34.738 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 15f3da95-ea91-4620-a05e-2bffbaac422d' 2026-02-21T12:05:34.739 INFO:tasks.workunit.client.0.trial058.stdout:add osd1 15f3da95-ea91-4620-a05e-2bffbaac422d 2026-02-21T12:05:34.739 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:05:34.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCOn5lpv+u9LRAANyMEhnbK++jCE3wxizGR4w== 2026-02-21T12:05:34.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCOn5lpv+u9LRAANyMEhnbK++jCE3wxizGR4w=="}' 2026-02-21T12:05:34.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 15f3da95-ea91-4620-a05e-2bffbaac422d -i td/bad-inc-map/1/new.json 2026-02-21T12:05:34.847 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:05:34.853 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/1/new.json 2026-02-21T12:05:34.854 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=95085676-fa59-4f5b-a8b1-b5be89008247 --auth-supported=none --mon-host=127.0.0.1:44503 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.37612/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCOn5lpv+u9LRAANyMEhnbK++jCE3wxizGR4w== --osd-uuid 15f3da95-ea91-4620-a05e-2bffbaac422d 2026-02-21T12:05:34.868 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:34.888+0000 7fce88a56780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:34.869 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:34.889+0000 7fce88a56780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:34.870 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:34.890+0000 7fce88a56780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:34.871 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:34.890+0000 7fce88a56780 -1 bdev(0x3390c00 td/bad-inc-map/1/block) open stat got: (1) Operation not permitted 2026-02-21T12:05:34.871 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:34.890+0000 7fce88a56780 -1 bluestore(td/bad-inc-map/1) _read_fsid unparsable uuid 2026-02-21T12:05:35.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/1/keyring 2026-02-21T12:05:35.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:05:35.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-21T12:05:35.252 INFO:tasks.workunit.client.0.trial058.stdout:adding osd1 key to auth repository 2026-02-21T12:05:35.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:05:35.566 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-21T12:05:35.567 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:05:35.568 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=95085676-fa59-4f5b-a8b1-b5be89008247 --auth-supported=none --mon-host=127.0.0.1:44503 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.37612/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:05:35.568 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:05:35.568 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:05:35.568 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:05:35.579 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:35.599+0000 7f55d9d3b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:35.581 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:35.600+0000 7f55d9d3b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:35.581 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:35.601+0000 7f55d9d3b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:35.712 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:35.731+0000 7f55d9d3b780 -1 Falling back to public interface 2026-02-21T12:05:35.787 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-21T12:05:35.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:05:35.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:05:35.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:05:35.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:05:35.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:05:35.788 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:05:35.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:05:35.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:35.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:05:35.985 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:36.004+0000 7f55d9d3b780 -1 osd.1 0 log_to_monitors true 2026-02-21T12:05:36.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:05:37.020 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:05:37.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:05:37.021 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:05:37.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:05:37.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:37.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:05:37.239 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4257605841,v1:127.0.0.1:6811/4257605841] [v2:127.0.0.1:6812/4257605841,v1:127.0.0.1:6813/4257605841] exists,up 15f3da95-ea91-4620-a05e-2bffbaac422d 2026-02-21T12:05:37.243 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:05:37.243 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:05:37.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:05:37.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:32: TEST_bad_inc_map: run_osd td/bad-inc-map 2 2026-02-21T12:05:37.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-21T12:05:37.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:05:37.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-21T12:05:37.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:05:37.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/2 2026-02-21T12:05:37.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=95085676-fa59-4f5b-a8b1-b5be89008247 --auth-supported=none --mon-host=127.0.0.1:44503 ' 2026-02-21T12:05:37.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:05:37.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:05:37.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:05:37.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/2' 2026-02-21T12:05:37.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/2/journal' 2026-02-21T12:05:37.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:05:37.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:05:37.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-21T12:05:37.245 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:05:37.245 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:05:37.245 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:05:37.245 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:05:37.245 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:37.245 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37612 2026-02-21T12:05:37.245 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37612/$cluster-$name.asok' 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37612/$cluster-$name.asok' 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:05:37.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/2 2026-02-21T12:05:37.247 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:05:37.247 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ac8356fe-4034-4627-a2cc-e4d684e41363 2026-02-21T12:05:37.247 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 ac8356fe-4034-4627-a2cc-e4d684e41363' 2026-02-21T12:05:37.247 INFO:tasks.workunit.client.0.trial058.stdout:add osd2 ac8356fe-4034-4627-a2cc-e4d684e41363 2026-02-21T12:05:37.247 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:05:37.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCRn5lpIAQ+EBAAvhb1CAwUask8qKibp/LoRQ== 2026-02-21T12:05:37.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCRn5lpIAQ+EBAAvhb1CAwUask8qKibp/LoRQ=="}' 2026-02-21T12:05:37.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ac8356fe-4034-4627-a2cc-e4d684e41363 -i td/bad-inc-map/2/new.json 2026-02-21T12:05:37.476 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:05:37.482 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/2/new.json 2026-02-21T12:05:37.483 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=95085676-fa59-4f5b-a8b1-b5be89008247 --auth-supported=none --mon-host=127.0.0.1:44503 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.37612/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCRn5lpIAQ+EBAAvhb1CAwUask8qKibp/LoRQ== --osd-uuid ac8356fe-4034-4627-a2cc-e4d684e41363 2026-02-21T12:05:37.497 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:37.517+0000 7fb960bd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:37.498 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:37.518+0000 7fb960bd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:37.499 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:37.519+0000 7fb960bd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:37.500 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:37.519+0000 7fb960bd8780 -1 bdev(0x36aec00 td/bad-inc-map/2/block) open stat got: (1) Operation not permitted 2026-02-21T12:05:37.500 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:37.519+0000 7fb960bd8780 -1 bluestore(td/bad-inc-map/2) _read_fsid unparsable uuid 2026-02-21T12:05:37.818 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/2/keyring 2026-02-21T12:05:37.819 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:05:37.819 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-21T12:05:37.820 INFO:tasks.workunit.client.0.trial058.stdout:adding osd2 key to auth repository 2026-02-21T12:05:37.820 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:05:38.136 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-21T12:05:38.137 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:05:38.138 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=95085676-fa59-4f5b-a8b1-b5be89008247 --auth-supported=none --mon-host=127.0.0.1:44503 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.37612/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:05:38.138 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:05:38.138 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:05:38.138 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:05:38.149 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:38.169+0000 7efece451780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:38.150 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:38.170+0000 7efece451780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:38.151 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:38.171+0000 7efece451780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:38.276 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:38.295+0000 7efece451780 -1 Falling back to public interface 2026-02-21T12:05:38.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-21T12:05:38.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:05:38.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:05:38.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:05:38.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:05:38.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:05:38.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:05:38.360 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:05:38.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:38.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:05:38.578 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:38.597+0000 7efece451780 -1 osd.2 0 log_to_monitors true 2026-02-21T12:05:38.582 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:05:39.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:05:39.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:05:39.584 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:05:39.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:05:39.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:39.586 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:05:39.808 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2696299418,v1:127.0.0.1:6819/2696299418] [v2:127.0.0.1:6820/2696299418,v1:127.0.0.1:6821/2696299418] exists,up ac8356fe-4034-4627-a2cc-e4d684e41363 2026-02-21T12:05:39.809 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:05:39.809 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:05:39.809 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:05:39.809 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:34: TEST_bad_inc_map: ceph config set osd.2 osd_inject_bad_map_crc_probability 1 2026-02-21T12:05:40.038 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:37: TEST_bad_inc_map: create_pool foo 8 2026-02-21T12:05:40.038 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 8 2026-02-21T12:05:40.311 INFO:tasks.workunit.client.0.trial058.stderr:pool 'foo' already exists 2026-02-21T12:05:40.318 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-21T12:05:41.320 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:38: TEST_bad_inc_map: ceph osd pool set foo min_size 1 2026-02-21T12:05:41.627 INFO:tasks.workunit.client.0.trial058.stderr:set pool 1 min_size to 1 2026-02-21T12:05:41.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:39: TEST_bad_inc_map: ceph osd pool set foo min_size 2 2026-02-21T12:05:41.946 INFO:tasks.workunit.client.0.trial058.stderr:set pool 1 min_size to 2 2026-02-21T12:05:41.959 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:41: TEST_bad_inc_map: sleep 5 2026-02-21T12:05:46.961 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: TIMEOUT=10 2026-02-21T12:05:46.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: wait_for_osd up 0 2026-02-21T12:05:46.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:05:46.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:05:46.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:05:46.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:05:46.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-21T12:05:46.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:05:46.963 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:05:46.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:46.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:05:47.184 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 5 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1702889615,v1:127.0.0.1:6801/1702889615] [v2:127.0.0.1:6802/1702889615,v1:127.0.0.1:6803/1702889615] exists,up d8d04ea3-6b94-4cea-8fdc-e1f986730234 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: TIMEOUT=10 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: wait_for_osd up 1 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:47.185 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:05:47.409 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4257605841,v1:127.0.0.1:6811/4257605841] [v2:127.0.0.1:6812/4257605841,v1:127.0.0.1:6813/4257605841] exists,up 15f3da95-ea91-4620-a05e-2bffbaac422d 2026-02-21T12:05:47.410 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:05:47.410 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:05:47.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:05:47.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: TIMEOUT=10 2026-02-21T12:05:47.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: wait_for_osd up 2 2026-02-21T12:05:47.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:05:47.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:05:47.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:05:47.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:05:47.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-21T12:05:47.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:05:47.412 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:05:47.412 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:47.412 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:05:47.629 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 14 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2696299418,v1:127.0.0.1:6819/2696299418] [v2:127.0.0.1:6820/2696299418,v1:127.0.0.1:6821/2696299418] exists,up ac8356fe-4034-4627-a2cc-e4d684e41363 2026-02-21T12:05:47.634 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:05:47.634 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:05:47.634 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:05:47.634 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:49: TEST_bad_inc_map: grep 'injecting map crc failure' td/bad-inc-map/osd.2.log 2026-02-21T12:05:47.635 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:40.268+0000 7efebd00b640 -1 osd.2 14 handle_osd_map injecting map crc failure 2026-02-21T12:05:47.635 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:40.373+0000 7efebd00b640 -1 osd.2 15 handle_osd_map injecting map crc failure 2026-02-21T12:05:47.635 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:40.474+0000 7efebd00b640 -1 osd.2 16 handle_osd_map injecting map crc failure 2026-02-21T12:05:47.635 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.547+0000 7efebb007640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-21T12:05:47.635 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.549+0000 7efebb007640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-21T12:05:47.635 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.647+0000 7efebd00b640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-21T12:05:47.635 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.647+0000 7efebd00b640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-21T12:05:47.636 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.866+0000 7efebb007640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-21T12:05:47.636 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.967+0000 7efebd00b640 -1 osd.2 20 handle_osd_map injecting map crc failure 2026-02-21T12:05:47.636 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.967+0000 7efebb007640 -1 osd.2 20 handle_osd_map injecting map crc failure 2026-02-21T12:05:47.636 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.968+0000 7efebb007640 -1 osd.2 20 handle_osd_map injecting map crc failure 2026-02-21T12:05:47.636 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:50: TEST_bad_inc_map: grep 'bailing because last' td/bad-inc-map/osd.2.log 2026-02-21T12:05:47.636 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:40.268+0000 7efebd00b640 10 osd.2 14 handle_osd_map bailing because last < start (14<15) 2026-02-21T12:05:47.637 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:40.373+0000 7efebd00b640 10 osd.2 15 handle_osd_map bailing because last < start (15<16) 2026-02-21T12:05:47.637 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:40.475+0000 7efebd00b640 10 osd.2 16 handle_osd_map bailing because last < start (16<17) 2026-02-21T12:05:47.637 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.548+0000 7efebb007640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-21T12:05:47.637 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.549+0000 7efebb007640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-21T12:05:47.637 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.647+0000 7efebd00b640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-21T12:05:47.637 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.647+0000 7efebd00b640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-21T12:05:47.637 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.867+0000 7efebb007640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-21T12:05:47.637 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.967+0000 7efebd00b640 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2026-02-21T12:05:47.637 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.967+0000 7efebb007640 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2026-02-21T12:05:47.637 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:05:41.968+0000 7efebb007640 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2026-02-21T12:05:47.638 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:52: TEST_bad_inc_map: echo success 2026-02-21T12:05:47.638 INFO:tasks.workunit.client.0.trial058.stdout:success 2026-02-21T12:05:47.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:54: TEST_bad_inc_map: delete_pool foo 2026-02-21T12:05:47.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=foo 2026-02-21T12:05:47.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2026-02-21T12:05:47.902 INFO:tasks.workunit.client.0.trial058.stderr:pool 'foo' does not exist 2026-02-21T12:05:47.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:55: TEST_bad_inc_map: kill_daemons td/bad-inc-map 2026-02-21T12:05:47.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:05:47.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:05:47.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:05:47.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:05:47.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:05:53.224 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:05:53.224 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:21: run: teardown td/bad-inc-map 2026-02-21T12:05:53.224 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-21T12:05:53.224 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:05:53.224 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-21T12:05:53.224 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:05:53.224 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:05:53.224 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:05:53.224 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:05:53.224 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:05:53.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:05:53.230 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:05:53.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:05:53.232 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:05:53.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:05:53.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:05:53.232 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:05:53.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:05:53.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:05:53.233 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:05:53.233 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:05:53.233 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:05:53.234 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:05:53.234 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-21T12:05:53.244 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:05:53.245 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:53.245 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37612 2026-02-21T12:05:53.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.37612 2026-02-21T12:05:53.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:05:53.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:05:53.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2429: main: code=0 2026-02-21T12:05:53.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2433: main: teardown td/bad-inc-map 0 2026-02-21T12:05:53.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-21T12:05:53.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-21T12:05:53.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-21T12:05:53.246 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:05:53.246 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:05:53.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:05:53.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:05:53.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:05:53.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:05:53.246 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:05:53.248 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:05:53.248 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:05:53.248 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:05:53.248 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:05:53.248 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:05:53.248 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:05:53.249 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:05:53.249 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:05:53.249 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:05:53.249 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:05:53.250 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-21T12:05:53.250 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-21T12:05:53.250 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:05:53.250 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:53.250 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37612 2026-02-21T12:05:53.250 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.37612 2026-02-21T12:05:53.253 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:05:53.253 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:05:53.253 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2434: main: return 0 2026-02-21T12:05:53.254 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-21T12:05:53.255 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-21T12:05:53.318 INFO:tasks.workunit:Running workunit osd/divergent-priors.sh... 2026-02-21T12:05:53.318 DEBUG:teuthology.orchestra.run.trial058:workunit test osd/divergent-priors.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f7273f3049146bdd7fa7b4a400114872a50228e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2026-02-21T12:05:53.380 INFO:tasks.workunit.client.0.trial058.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-21T12:05:53.386 INFO:tasks.workunit.client.0.trial058.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-21T12:05:53.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2422: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-21T12:05:53.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2422: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-21T12:05:53.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: main: export PYTHONWARNINGS=ignore 2026-02-21T12:05:53.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: main: PYTHONWARNINGS=ignore 2026-02-21T12:05:53.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2424: main: export CEPH_CONF=/dev/null 2026-02-21T12:05:53.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2424: main: CEPH_CONF=/dev/null 2026-02-21T12:05:53.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2425: main: unset CEPH_ARGS 2026-02-21T12:05:53.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: main: local code 2026-02-21T12:05:53.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2428: main: run td/divergent-priors 2026-02-21T12:05:53.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:21: run: local dir=td/divergent-priors 2026-02-21T12:05:53.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:22: run: shift 2026-02-21T12:05:53.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: export loglen=12 2026-02-21T12:05:53.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: loglen=12 2026-02-21T12:05:53.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: export divisor=3 2026-02-21T12:05:53.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: divisor=3 2026-02-21T12:05:53.387 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: expr 12 / 2 2026-02-21T12:05:53.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: export trim=6 2026-02-21T12:05:53.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: trim=6 2026-02-21T12:05:53.388 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: expr 6 / 3 2026-02-21T12:05:53.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: export DIVERGENT_WRITE=2 2026-02-21T12:05:53.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: DIVERGENT_WRITE=2 2026-02-21T12:05:53.390 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: expr 6 / 3 2026-02-21T12:05:53.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: export DIVERGENT_REMOVE=2 2026-02-21T12:05:53.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: DIVERGENT_REMOVE=2 2026-02-21T12:05:53.390 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: expr 6 / 3 2026-02-21T12:05:53.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: export DIVERGENT_CREATE=2 2026-02-21T12:05:53.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: DIVERGENT_CREATE=2 2026-02-21T12:05:53.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: export poolname=test 2026-02-21T12:05:53.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: poolname=test 2026-02-21T12:05:53.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: export testobjects=100 2026-02-21T12:05:53.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: testobjects=100 2026-02-21T12:05:53.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: export CEPH_MON=127.0.0.1:7115 2026-02-21T12:05:53.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: CEPH_MON=127.0.0.1:7115 2026-02-21T12:05:53.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:35: run: export CEPH_ARGS 2026-02-21T12:05:53.391 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: uuidgen 2026-02-21T12:05:53.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: CEPH_ARGS+='--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none ' 2026-02-21T12:05:53.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:37: run: CEPH_ARGS+='--mon-host=127.0.0.1:7115 ' 2026-02-21T12:05:53.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:39: run: CEPH_ARGS+='--osd_force_auth_primary_missing_objects=1000000 ' 2026-02-21T12:05:53.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:40: run: CEPH_ARGS+='--osd_debug_pg_log_writeout=true ' 2026-02-21T12:05:53.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:41: run: CEPH_ARGS+='--osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:05:53.393 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: set 2026-02-21T12:05:53.394 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-21T12:05:53.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: local 'funcs=TEST_divergent 2026-02-21T12:05:53.394 INFO:tasks.workunit.client.0.trial058.stderr:TEST_divergent_2 2026-02-21T12:05:53.394 INFO:tasks.workunit.client.0.trial058.stderr:TEST_divergent_3 2026-02-21T12:05:53.394 INFO:tasks.workunit.client.0.trial058.stderr:TEST_divergent_ec' 2026-02-21T12:05:53.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-21T12:05:53.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-21T12:05:53.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-21T12:05:53.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-21T12:05:53.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-21T12:05:53.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:05:53.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-21T12:05:53.395 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:05:53.395 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:05:53.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:05:53.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:05:53.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:05:53.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:05:53.396 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:05:53.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:05:53.396 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:05:53.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:05:53.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:05:53.397 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:05:53.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:05:53.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:05:53.398 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:05:53.398 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:05:53.398 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:05:53.399 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:05:53.399 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-21T12:05:53.400 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:05:53.400 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:53.400 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:05:53.400 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.43953 2026-02-21T12:05:53.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:05:53.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:05:53.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-21T12:05:53.402 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-21T12:05:53.402 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:53.402 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:05:53.402 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.43953 2026-02-21T12:05:53.403 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-21T12:05:53.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-21T12:05:53.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-21T12:05:53.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-21T12:05:53.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-21T12:05:53.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent td/divergent-priors 2026-02-21T12:05:53.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:57: TEST_divergent: local dir=td/divergent-priors 2026-02-21T12:05:53.405 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: file_with_random_data 2026-02-21T12:05:53.405 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: file_with_random_data: local size_bytes=512 2026-02-21T12:05:53.405 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: mktemp 2026-02-21T12:05:53.406 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: local file=/tmp/tmp.Uv04UgQ8SG 2026-02-21T12:05:53.406 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.Uv04UgQ8SG bs=512 count=1 2026-02-21T12:05:53.406 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records in 2026-02-21T12:05:53.406 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records out 2026-02-21T12:05:53.406 INFO:tasks.workunit.client.0.trial058.stderr:512 bytes copied, 5.0034e-05 s, 10.2 MB/s 2026-02-21T12:05:53.407 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: file_with_random_data: printf %s /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:05:53.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: local dummyfile=/tmp/tmp.Uv04UgQ8SG 2026-02-21T12:05:53.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:60: TEST_divergent: local num_osds=3 2026-02-21T12:05:53.407 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: expr 3 - 1 2026-02-21T12:05:53.407 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: seq 0 2 2026-02-21T12:05:53.408 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: local 'osds=0 2026-02-21T12:05:53.409 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:05:53.409 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:05:53.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:62: TEST_divergent: run_mon td/divergent-priors a 2026-02-21T12:05:53.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-21T12:05:53.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-21T12:05:53.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-21T12:05:53.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-21T12:05:53.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-21T12:05:53.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-21T12:05:53.429 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-21T12:05:53.429 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:05:53.429 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:05:53.429 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:05:53.429 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:53.429 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:05:53.429 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:05:53.429 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-21T12:05:53.455 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-21T12:05:53.458 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-21T12:05:53.458 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:05:53.458 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:05:53.459 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-21T12:05:53.459 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-21T12:05:53.459 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:05:53.459 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:05:53.459 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:05:53.459 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:05:53.459 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:53.459 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:05:53.459 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-mon.a.asok 2026-02-21T12:05:53.459 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:05:53.460 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.43953/ceph-mon.a.asok config get fsid 2026-02-21T12:05:53.500 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-21T12:05:53.500 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:05:53.500 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:05:53.500 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-21T12:05:53.500 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-21T12:05:53.500 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:05:53.500 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:05:53.500 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:05:53.501 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:05:53.501 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:53.501 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:05:53.501 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-mon.a.asok 2026-02-21T12:05:53.501 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:05:53.501 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.43953/ceph-mon.a.asok config get mon_host 2026-02-21T12:05:53.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:63: TEST_divergent: run_mgr td/divergent-priors x 2026-02-21T12:05:53.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-21T12:05:53.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-21T12:05:53.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-21T12:05:53.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-21T12:05:53.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-21T12:05:53.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-21T12:05:53.641 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-21T12:05:53.641 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:05:53.642 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:05:53.642 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:05:53.642 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:53.642 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:05:53.642 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:05:53.642 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:05:53.643 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:05:53.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-21T12:05:53.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 0 2026-02-21T12:05:53.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-21T12:05:53.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:05:53.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-21T12:05:53.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:05:53.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-21T12:05:53.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:05:53.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:05:53.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:05:53.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:05:53.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-21T12:05:53.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-21T12:05:53.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:05:53.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:05:53.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:05:53.665 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:05:53.665 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:05:53.665 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:05:53.665 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:05:53.665 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:53.665 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:05:53.665 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:05:53.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:05:53.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:05:53.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:05:53.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:05:53.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:05:53.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:05:53.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:05:53.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:05:53.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:05:53.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:05:53.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:05:53.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:05:53.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-21T12:05:53.666 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:05:53.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=88e4c84b-df35-45e5-ad58-d9d691d7ffd7 2026-02-21T12:05:53.667 INFO:tasks.workunit.client.0.trial058.stdout:add osd0 88e4c84b-df35-45e5-ad58-d9d691d7ffd7 2026-02-21T12:05:53.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 88e4c84b-df35-45e5-ad58-d9d691d7ffd7' 2026-02-21T12:05:53.667 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:05:53.676 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQChn5lpekx6KRAAtZyav0sDZLPCaUdId4P1Dg== 2026-02-21T12:05:53.676 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQChn5lpekx6KRAAtZyav0sDZLPCaUdId4P1Dg=="}' 2026-02-21T12:05:53.676 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 88e4c84b-df35-45e5-ad58-d9d691d7ffd7 -i td/divergent-priors/0/new.json 2026-02-21T12:05:53.778 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:05:53.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-21T12:05:53.785 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQChn5lpekx6KRAAtZyav0sDZLPCaUdId4P1Dg== --osd-uuid 88e4c84b-df35-45e5-ad58-d9d691d7ffd7 2026-02-21T12:05:53.805 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:53.825+0000 7f28d5068780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:53.806 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:53.827+0000 7f28d5068780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:53.807 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:53.828+0000 7f28d5068780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:53.808 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:53.828+0000 7f28d5068780 -1 bdev(0x3e84c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-21T12:05:53.808 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:53.828+0000 7f28d5068780 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-21T12:05:54.239 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-21T12:05:54.239 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:05:54.240 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-21T12:05:54.240 INFO:tasks.workunit.client.0.trial058.stdout:adding osd0 key to auth repository 2026-02-21T12:05:54.240 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:05:54.347 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-21T12:05:54.348 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:05:54.349 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:05:54.349 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:05:54.349 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:05:54.349 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:05:54.366 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:54.387+0000 7f1795855780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:54.368 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:54.388+0000 7f1795855780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:54.368 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:54.389+0000 7f1795855780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:54.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-21T12:05:54.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:05:54.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:05:54.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:05:54.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:05:54.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:05:54.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:05:54.449 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:05:54.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:54.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:05:54.551 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:05:54.563 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:54.583+0000 7f1795855780 -1 Falling back to public interface 2026-02-21T12:05:54.900 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:54.920+0000 7f1795855780 -1 osd.0 0 log_to_monitors true 2026-02-21T12:05:55.552 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:05:55.552 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:05:55.552 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:05:55.553 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:05:55.553 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:55.553 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:05:55.652 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/878855437,v1:127.0.0.1:6801/878855437] [v2:127.0.0.1:6802/878855437,v1:127.0.0.1:6803/878855437] exists,up 88e4c84b-df35-45e5-ad58-d9d691d7ffd7 2026-02-21T12:05:55.656 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:05:55.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:05:55.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:05:55.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-21T12:05:55.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 1 2026-02-21T12:05:55.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-21T12:05:55.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:05:55.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-21T12:05:55.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:05:55.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-21T12:05:55.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:05:55.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:05:55.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:05:55.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:05:55.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ca7b3c07-e0ce-443d-bdc4-b13f31d94275 2026-02-21T12:05:55.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ca7b3c07-e0ce-443d-bdc4-b13f31d94275' 2026-02-21T12:05:55.660 INFO:tasks.workunit.client.0.trial058.stdout:add osd1 ca7b3c07-e0ce-443d-bdc4-b13f31d94275 2026-02-21T12:05:55.660 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:05:55.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCjn5lpBDsPKRAA3dM6vw1/Kz8OrN4PxTqL2Q== 2026-02-21T12:05:55.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCjn5lpBDsPKRAA3dM6vw1/Kz8OrN4PxTqL2Q=="}' 2026-02-21T12:05:55.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ca7b3c07-e0ce-443d-bdc4-b13f31d94275 -i td/divergent-priors/1/new.json 2026-02-21T12:05:55.774 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:05:55.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-21T12:05:55.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCjn5lpBDsPKRAA3dM6vw1/Kz8OrN4PxTqL2Q== --osd-uuid ca7b3c07-e0ce-443d-bdc4-b13f31d94275 2026-02-21T12:05:55.800 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:55.820+0000 7f3ddce4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:55.802 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:55.822+0000 7f3ddce4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:55.803 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:55.822+0000 7f3ddce4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:55.803 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:55.823+0000 7f3ddce4b780 -1 bdev(0x2e4ac00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-21T12:05:55.803 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:55.823+0000 7f3ddce4b780 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-21T12:05:56.126 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-21T12:05:56.126 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:05:56.127 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-21T12:05:56.127 INFO:tasks.workunit.client.0.trial058.stdout:adding osd1 key to auth repository 2026-02-21T12:05:56.127 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:05:56.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-21T12:05:56.445 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:05:56.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:05:56.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:05:56.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:05:56.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:05:56.463 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:56.484+0000 7fe0cc610780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:56.465 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:56.485+0000 7fe0cc610780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:56.465 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:56.486+0000 7fe0cc610780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:56.618 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:56.639+0000 7fe0cc610780 -1 Falling back to public interface 2026-02-21T12:05:56.671 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-21T12:05:56.671 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:05:56.671 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:05:56.671 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:05:56.671 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:05:56.671 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:05:56.671 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:05:56.671 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:05:56.671 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:56.671 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:05:56.900 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:05:56.968 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:56.988+0000 7fe0cc610780 -1 osd.1 0 log_to_monitors true 2026-02-21T12:05:57.901 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:05:57.902 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:05:57.902 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:05:57.903 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:05:57.903 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:57.903 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:05:58.130 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4177717301,v1:127.0.0.1:6811/4177717301] [v2:127.0.0.1:6812/4177717301,v1:127.0.0.1:6813/4177717301] exists,up ca7b3c07-e0ce-443d-bdc4-b13f31d94275 2026-02-21T12:05:58.133 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:05:58.133 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:05:58.133 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 2 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=af9fb76e-a465-4e68-abc1-80968c90b791 2026-02-21T12:05:58.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 af9fb76e-a465-4e68-abc1-80968c90b791' 2026-02-21T12:05:58.135 INFO:tasks.workunit.client.0.trial058.stdout:add osd2 af9fb76e-a465-4e68-abc1-80968c90b791 2026-02-21T12:05:58.135 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:05:58.145 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCmn5lptOzpCRAAG6HTftoCHN+xdpT4NSvJRw== 2026-02-21T12:05:58.145 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCmn5lptOzpCRAAG6HTftoCHN+xdpT4NSvJRw=="}' 2026-02-21T12:05:58.145 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new af9fb76e-a465-4e68-abc1-80968c90b791 -i td/divergent-priors/2/new.json 2026-02-21T12:05:58.383 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:05:58.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-21T12:05:58.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCmn5lptOzpCRAAG6HTftoCHN+xdpT4NSvJRw== --osd-uuid af9fb76e-a465-4e68-abc1-80968c90b791 2026-02-21T12:05:58.410 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:58.430+0000 7f507b3fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:58.411 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:58.432+0000 7f507b3fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:58.412 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:58.433+0000 7f507b3fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:58.413 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:58.433+0000 7f507b3fd780 -1 bdev(0x26aec00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-21T12:05:58.413 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:58.433+0000 7f507b3fd780 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-21T12:05:58.725 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-21T12:05:58.725 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:05:58.726 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-21T12:05:58.726 INFO:tasks.workunit.client.0.trial058.stdout:adding osd2 key to auth repository 2026-02-21T12:05:58.726 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:05:59.047 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:05:59.047 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-21T12:05:59.047 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:05:59.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:05:59.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:05:59.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:05:59.064 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:59.084+0000 7f4e7ae09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:59.065 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:59.086+0000 7f4e7ae09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:59.066 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:59.087+0000 7f4e7ae09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:05:59.193 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:59.213+0000 7f4e7ae09780 -1 Falling back to public interface 2026-02-21T12:05:59.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-21T12:05:59.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:05:59.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:05:59.276 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:05:59.276 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:05:59.276 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:05:59.276 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:05:59.276 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:05:59.277 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:05:59.277 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:05:59.490 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:05:59.510+0000 7f4e7ae09780 -1 osd.2 0 log_to_monitors true 2026-02-21T12:05:59.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:06:00.508 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:06:00.508 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:06:00.509 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:06:00.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:06:00.510 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:06:00.510 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:06:00.739 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3293925113,v1:127.0.0.1:6819/3293925113] [v2:127.0.0.1:6820/3293925113,v1:127.0.0.1:6821/3293925113] exists,up af9fb76e-a465-4e68-abc1-80968c90b791 2026-02-21T12:06:00.739 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:06:00.739 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:06:00.740 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:06:00.740 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: ceph osd set noout 2026-02-21T12:06:01.055 INFO:tasks.workunit.client.0.trial058.stderr:noout is set 2026-02-21T12:06:01.062 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:70: TEST_divergent: ceph osd set noin 2026-02-21T12:06:01.360 INFO:tasks.workunit.client.0.trial058.stderr:noin is set 2026-02-21T12:06:01.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:71: TEST_divergent: ceph osd set nodown 2026-02-21T12:06:01.663 INFO:tasks.workunit.client.0.trial058.stderr:nodown is set 2026-02-21T12:06:01.673 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:72: TEST_divergent: create_pool test 1 1 2026-02-21T12:06:01.673 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-21T12:06:01.928 INFO:tasks.workunit.client.0.trial058.stderr:pool 'test' already exists 2026-02-21T12:06:01.935 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-21T12:06:02.937 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:73: TEST_divergent: ceph osd pool set test size 3 2026-02-21T12:06:03.245 INFO:tasks.workunit.client.0.trial058.stderr:set pool 1 size to 3 2026-02-21T12:06:03.254 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:74: TEST_divergent: ceph osd pool set test min_size 2 2026-02-21T12:06:03.548 INFO:tasks.workunit.client.0.trial058.stderr:set pool 1 min_size to 2 2026-02-21T12:06:03.558 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:76: TEST_divergent: flush_pg_stats 2026-02-21T12:06:03.558 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:06:03.558 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:06:03.783 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:06:03.783 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:06:03.783 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:06:03.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:06:03.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:06:03.784 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:06:03.852 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836484 2026-02-21T12:06:03.853 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836484 2026-02-21T12:06:03.853 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836484' 2026-02-21T12:06:03.853 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:06:03.853 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:06:03.920 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=38654705668 2026-02-21T12:06:03.920 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 38654705668 2026-02-21T12:06:03.920 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836484 1-38654705668' 2026-02-21T12:06:03.920 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:06:03.920 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:06:03.987 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=60129542147 2026-02-21T12:06:03.987 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 60129542147 2026-02-21T12:06:03.987 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836484 1-38654705668 2-60129542147' 2026-02-21T12:06:03.987 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:06:03.987 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836484 2026-02-21T12:06:03.987 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:06:03.987 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:06:03.988 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836484 2026-02-21T12:06:03.988 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:06:03.989 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836484 2026-02-21T12:06:03.989 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-21T12:06:03.989 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836484 2026-02-21T12:06:03.990 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:06:04.215 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-21T12:06:04.216 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:06:05.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:06:05.217 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:06:05.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-21T12:06:05.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:06:06.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-21T12:06:06.448 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:06:06.679 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-21T12:06:06.679 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:06:06.680 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-38654705668 2026-02-21T12:06:06.680 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:06:06.681 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:06:06.681 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-38654705668 2026-02-21T12:06:06.682 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:06:06.683 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=38654705668 2026-02-21T12:06:06.683 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 38654705668 2026-02-21T12:06:06.683 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-21T12:06:06.683 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:06:06.914 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-21T12:06:06.914 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:06:06.915 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-60129542147 2026-02-21T12:06:06.915 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:06:06.915 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:06:06.916 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-60129542147 2026-02-21T12:06:06.916 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:06:06.917 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=60129542147 2026-02-21T12:06:06.917 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-21T12:06:06.918 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 60129542147 2026-02-21T12:06:06.918 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:06:07.145 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 60129542148 -lt 60129542147 2026-02-21T12:06:07.145 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:77: TEST_divergent: wait_for_clean 2026-02-21T12:06:07.145 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:06:07.145 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:06:07.145 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:06:07.145 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-21T12:06:07.146 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:06:07.146 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:06:07.146 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:06:07.146 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:06:07.146 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:06:07.228 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-21T12:06:07.228 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:06:07.228 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:06:07.228 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:06:07.228 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:06:07.228 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:06:07.460 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:06:07.460 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:06:07.460 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:06:07.460 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:06:07.460 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:06:07.461 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:06:07.526 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836487 2026-02-21T12:06:07.526 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836487 2026-02-21T12:06:07.526 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836487' 2026-02-21T12:06:07.527 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:06:07.527 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:06:07.593 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=38654705670 2026-02-21T12:06:07.593 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 38654705670 2026-02-21T12:06:07.594 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-21T12:06:07.594 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:06:07.594 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:06:07.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=60129542150 2026-02-21T12:06:07.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 60129542150 2026-02-21T12:06:07.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-60129542150' 2026-02-21T12:06:07.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:06:07.661 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836487 2026-02-21T12:06:07.662 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:06:07.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:06:07.663 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836487 2026-02-21T12:06:07.663 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:06:07.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836487 2026-02-21T12:06:07.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-21T12:06:07.664 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836487 2026-02-21T12:06:07.665 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:06:07.893 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-21T12:06:07.893 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:06:07.893 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-38654705670 2026-02-21T12:06:07.894 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:06:07.894 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:06:07.895 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-38654705670 2026-02-21T12:06:07.895 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:06:07.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=38654705670 2026-02-21T12:06:07.896 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 38654705670 2026-02-21T12:06:07.897 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-21T12:06:07.897 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:06:08.123 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-21T12:06:08.123 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:06:08.123 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-60129542150 2026-02-21T12:06:08.124 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:06:08.124 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:06:08.125 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-60129542150 2026-02-21T12:06:08.125 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:06:08.126 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=60129542150 2026-02-21T12:06:08.126 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-21T12:06:08.126 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 60129542150 2026-02-21T12:06:08.126 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:06:08.354 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-21T12:06:08.354 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:06:08.355 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:08.355 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:08.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:06:08.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:06:08.670 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:06:08.670 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:06:08.670 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:06:08.670 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:06:08.670 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:06:08.670 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:06:08.894 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-21T12:06:08.894 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:06:08.894 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:08.895 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:09.221 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-21T12:06:09.221 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:06:09.221 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:06:09.221 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: ceph pg dump pgs --format=json 2026-02-21T12:06:09.221 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: jq '.pg_stats[0].up_primary' 2026-02-21T12:06:09.438 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:06:09.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: local divergent=1 2026-02-21T12:06:09.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:81: TEST_divergent: echo 'primary and soon to be divergent is 1' 2026-02-21T12:06:09.446 INFO:tasks.workunit.client.0.trial058.stdout:primary and soon to be divergent is 1 2026-02-21T12:06:09.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:82: TEST_divergent: ceph pg dump pgs 2026-02-21T12:06:09.662 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:06:09.662 INFO:tasks.workunit.client.0.trial058.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-21T12:06:03.010226+0000 0'0 28:22 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T15:53:18.709303+0000 0 0 2026-02-21T12:06:09.662 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:06:09.662 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:06:09.662 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:06:09.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: local non_divergent= 2026-02-21T12:06:09.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-21T12:06:09.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 0 = 1 ']' 2026-02-21T12:06:09.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0' 2026-02-21T12:06:09.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-21T12:06:09.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 1 = 1 ']' 2026-02-21T12:06:09.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: continue 2026-02-21T12:06:09.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-21T12:06:09.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 2 = 1 ']' 2026-02-21T12:06:09.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0 2' 2026-02-21T12:06:09.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: echo 'writing initial objects' 2026-02-21T12:06:09.670 INFO:tasks.workunit.client.0.trial058.stdout:writing initial objects 2026-02-21T12:06:09.671 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: seq 1 100 2026-02-21T12:06:09.671 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.671 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_1 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.691 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.691 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_2 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_3 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.727 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.727 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_4 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.745 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.745 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_5 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.764 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.764 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_6 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.782 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.782 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_7 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.800 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.800 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_8 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.818 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_9 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.836 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.836 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_10 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.853 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.853 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_11 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.871 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_12 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.890 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.890 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_13 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.907 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_14 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_15 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.942 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.942 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_16 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.960 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.960 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_17 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.978 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.979 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_18 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:09.996 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:09.996 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_19 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.015 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.015 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_20 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_21 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.051 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.051 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_22 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.068 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.069 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_23 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.086 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.087 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_24 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.106 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.106 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_25 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.124 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.125 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_26 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.144 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.144 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_27 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_28 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_29 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.198 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.198 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_30 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_31 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.235 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.235 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_32 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_33 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.270 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.270 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_34 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.288 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.288 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_35 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.306 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.306 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_36 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.324 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.324 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_37 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.342 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.343 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_38 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.361 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.361 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_39 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.380 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.380 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_40 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_41 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.416 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.416 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_42 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.434 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.434 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_43 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.453 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.453 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_44 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_45 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.489 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.489 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_46 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_47 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.525 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.526 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_48 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.544 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_49 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.562 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.562 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_50 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_51 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.597 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.597 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_52 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.615 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.615 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_53 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_54 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.652 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.652 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_55 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.671 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.672 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_56 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.690 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.691 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_57 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_58 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_59 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_60 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_61 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.785 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.786 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_62 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_63 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.822 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.822 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_64 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.841 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.841 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_65 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_66 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_67 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.897 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_68 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.915 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.915 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_69 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.933 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.933 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_70 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_71 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.970 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.970 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_72 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:10.989 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:10.989 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_73 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_74 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.026 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.026 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_75 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_76 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.063 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.063 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_77 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.081 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.082 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_78 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.100 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.100 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_79 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.118 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.118 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_80 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.136 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.136 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_81 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_82 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.173 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.173 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_83 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.192 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.192 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_84 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.210 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.210 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_85 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_86 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.248 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.248 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_87 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.267 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.267 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_88 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.285 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.285 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_89 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.303 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.303 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_90 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_91 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.340 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.341 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_92 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_93 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.377 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.377 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_94 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_95 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.415 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.415 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_96 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.434 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.434 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_97 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.452 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.453 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_98 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_99 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.490 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-21T12:06:11.490 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_100 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:11.508 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-21T12:06:11.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: wait_for_clean 2026-02-21T12:06:11.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:06:11.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:06:11.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:06:11.509 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-21T12:06:11.510 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:06:11.510 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:06:11.510 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:06:11.510 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:06:11.510 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:06:11.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-21T12:06:11.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:06:11.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:06:11.562 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:06:11.562 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:06:11.562 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:06:11.793 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:06:11.793 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:06:11.793 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:06:11.793 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:06:11.793 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:06:11.793 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:06:11.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836490 2026-02-21T12:06:11.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836490 2026-02-21T12:06:11.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836490' 2026-02-21T12:06:11.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:06:11.860 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:06:11.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=38654705673 2026-02-21T12:06:11.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 38654705673 2026-02-21T12:06:11.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836490 1-38654705673' 2026-02-21T12:06:11.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:06:11.930 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:06:12.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=60129542153 2026-02-21T12:06:12.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 60129542153 2026-02-21T12:06:12.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836490 1-38654705673 2-60129542153' 2026-02-21T12:06:12.001 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:06:12.001 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836490 2026-02-21T12:06:12.001 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:06:12.002 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:06:12.003 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836490 2026-02-21T12:06:12.003 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:06:12.003 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836490 2026-02-21T12:06:12.004 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-21T12:06:12.004 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836490 2026-02-21T12:06:12.004 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:06:12.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-21T12:06:12.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:06:13.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:06:13.231 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:06:13.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-21T12:06:13.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:06:14.458 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-21T12:06:14.459 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:06:14.687 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-21T12:06:14.687 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:06:14.688 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-38654705673 2026-02-21T12:06:14.688 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:06:14.689 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:06:14.690 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-38654705673 2026-02-21T12:06:14.690 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:06:14.691 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=38654705673 2026-02-21T12:06:14.691 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-21T12:06:14.691 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 38654705673 2026-02-21T12:06:14.691 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:06:14.919 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 38654705674 -lt 38654705673 2026-02-21T12:06:14.919 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:06:14.919 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-60129542153 2026-02-21T12:06:14.920 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:06:14.920 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:06:14.921 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-60129542153 2026-02-21T12:06:14.921 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:06:14.922 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=60129542153 2026-02-21T12:06:14.923 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-21T12:06:14.923 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 60129542153 2026-02-21T12:06:14.923 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:06:15.151 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-21T12:06:15.152 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:06:15.152 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:15.152 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:15.473 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:06:15.473 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:06:15.473 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:06:15.473 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:06:15.473 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:06:15.473 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:06:15.473 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:06:15.473 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:06:15.699 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-21T12:06:15.700 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:06:15.700 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:15.700 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:16.016 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-21T12:06:16.016 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:06:16.016 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:06:16.016 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: get_pg test existing_1 2026-02-21T12:06:16.017 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-21T12:06:16.017 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-21T12:06:16.017 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-21T12:06:16.017 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-21T12:06:16.250 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: local pgid=1.0 2026-02-21T12:06:16.250 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: echo 'blackholing osds 0 2' 2026-02-21T12:06:16.250 INFO:tasks.workunit.client.0.trial058.stdout:blackholing osds 0 2 2026-02-21T12:06:16.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:105: TEST_divergent: ceph pg dump pgs 2026-02-21T12:06:16.466 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:06:16.466 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-21T12:06:03.010226+0000 28'100 28:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T15:53:18.709303+0000 0 0 2026-02-21T12:06:16.467 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:06:16.467 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:06:16.467 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:06:16.473 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-21T12:06:16.473 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.0 2026-02-21T12:06:16.473 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-21T12:06:16.474 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-21T12:06:16.474 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:06:16.474 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:06:16.474 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:06:16.474 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.0.asok 2026-02-21T12:06:16.474 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-21T12:06:16.474 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-21T12:06:16.519 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:06:16.519 INFO:tasks.workunit.client.0.trial058.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-21T12:06:16.519 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:06:16.524 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-21T12:06:16.526 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.2 2026-02-21T12:06:16.526 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-21T12:06:16.526 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-21T12:06:16.526 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:06:16.526 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:06:16.526 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:06:16.526 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.2.asok 2026-02-21T12:06:16.527 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-21T12:06:16.527 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-21T12:06:16.569 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:06:16.569 INFO:tasks.workunit.client.0.trial058.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-21T12:06:16.569 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:06:16.574 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: local case5=100 2026-02-21T12:06:16.575 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: expr 100 - 1 2026-02-21T12:06:16.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: local case3=99 2026-02-21T12:06:16.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:114: TEST_divergent: echo 'writing divergent object' 2026-02-21T12:06:16.576 INFO:tasks.workunit.client.0.trial058.stdout:writing divergent object 2026-02-21T12:06:16.577 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:116: TEST_divergent: echo 'create missing divergent object' 2026-02-21T12:06:16.577 INFO:tasks.workunit.client.0.trial058.stdout:create missing divergent object 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:117: TEST_divergent: inject_eio rep data test existing_99 td/divergent-priors 0 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: rados -p test put existing_100 /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2509: inject_eio: local pooltype=rep 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2510: inject_eio: shift 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2511: inject_eio: local which=data 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: inject_eio: shift 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2513: inject_eio: local poolname=test 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2514: inject_eio: shift 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2515: inject_eio: local objname=existing_99 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2516: inject_eio: shift 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2517: inject_eio: local dir=td/divergent-priors 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2518: inject_eio: shift 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2519: inject_eio: local shard_id=0 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2520: inject_eio: shift 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: inject_eio: get_osds test existing_99 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=existing_99 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test existing_99 2026-02-21T12:06:16.579 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-21T12:06:16.810 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-21T12:06:16.811 INFO:tasks.workunit.client.0.trial058.stderr:0 2026-02-21T12:06:16.811 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:06:16.811 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 2026-02-21T12:06:16.811 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: inject_eio: initial_osds=('1' '0' '2') 2026-02-21T12:06:16.811 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: inject_eio: local -a initial_osds 2026-02-21T12:06:16.811 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: inject_eio: local osd_id=1 2026-02-21T12:06:16.811 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: inject_eio: '[' rep '!=' ec ']' 2026-02-21T12:06:16.811 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2525: inject_eio: shard_id= 2026-02-21T12:06:16.811 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2527: inject_eio: cat td/divergent-priors/1/type 2026-02-21T12:06:16.812 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2527: inject_eio: type=bluestore 2026-02-21T12:06:16.812 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-21T12:06:16.812 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-21T12:06:16.812 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-21T12:06:16.812 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-21T12:06:16.812 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-21T12:06:16.813 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-21T12:06:16.813 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-21T12:06:16.813 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-21T12:06:16.813 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-21T12:06:16.813 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:06:16.813 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:06:16.814 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:06:16.814 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.1.asok 2026-02-21T12:06:16.814 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.43953/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-21T12:06:16.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-21T12:06:16.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2529: inject_eio: local loop=0 2026-02-21T12:06:16.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: inject_eio: grep -q Invalid 2026-02-21T12:06:16.861 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: inject_eio: get_asok_path osd.1 2026-02-21T12:06:16.861 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-21T12:06:16.861 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-21T12:06:16.861 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:06:16.861 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:06:16.861 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:06:16.861 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.1.asok 2026-02-21T12:06:16.862 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: inject_eio: CEPH_ARGS= 2026-02-21T12:06:16.862 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: inject_eio: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.1.asok injectdataerr test existing_99 2026-02-21T12:06:16.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:119: TEST_divergent: sleep 10 2026-02-21T12:06:16.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:118: TEST_divergent: rados -p test get existing_99 td/divergent-priors/existing 2026-02-21T12:06:26.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:120: TEST_divergent: killall -9 rados 2026-02-21T12:06:26.939 INFO:tasks.workunit.client.0.trial058.stderr:rados: no process found 2026-02-21T12:06:26.940 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:123: TEST_divergent: echo 'killing all the osds' 2026-02-21T12:06:26.940 INFO:tasks.workunit.client.0.trial058.stdout:killing all the osds 2026-02-21T12:06:26.941 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:124: TEST_divergent: ceph pg dump pgs 2026-02-21T12:06:27.155 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:06:27.155 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 active+clean 2026-02-21T12:06:16.950040+0000 28'101 28:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T15:53:18.709303+0000 0 0 2026-02-21T12:06:27.155 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:06:27.156 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:06:27.156 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:06:27.163 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:125: TEST_divergent: kill_daemons td/divergent-priors KILL osd 2026-02-21T12:06:27.163 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:06:27.163 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:06:27.163 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:06:27.163 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:06:27.163 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:06:27.271 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:06:27.271 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-21T12:06:27.271 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.0 2026-02-21T12:06:27.552 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already down. 2026-02-21T12:06:27.560 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-21T12:06:27.560 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.1 2026-02-21T12:06:27.859 INFO:tasks.workunit.client.0.trial058.stderr:osd.1 is already down. 2026-02-21T12:06:27.867 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-21T12:06:27.867 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.2 2026-02-21T12:06:28.156 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already down. 2026-02-21T12:06:28.164 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-21T12:06:28.164 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.0 2026-02-21T12:06:28.443 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already out. 2026-02-21T12:06:28.451 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-21T12:06:28.451 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.2 2026-02-21T12:06:28.731 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already out. 2026-02-21T12:06:28.738 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:136: TEST_divergent: echo 'bringing up non_divergent 0 2' 2026-02-21T12:06:28.738 INFO:tasks.workunit.client.0.trial058.stdout:bringing up non_divergent 0 2 2026-02-21T12:06:28.739 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:137: TEST_divergent: ceph pg dump pgs 2026-02-21T12:06:28.953 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:06:28.953 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 stale+active+clean 2026-02-21T12:06:16.950040+0000 28'101 28:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T15:53:18.709303+0000 0 0 2026-02-21T12:06:28.953 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:06:28.953 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:06:28.953 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 0 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:06:28.962 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:06:28.963 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-21T12:06:28.964 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-21T12:06:28.964 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:06:28.964 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:06:28.964 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:06:28.983 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:06:29.004+0000 7eff96856780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:06:28.985 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:06:29.005+0000 7eff96856780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:06:28.985 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:06:29.006+0000 7eff96856780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:06:29.107 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:06:29.128+0000 7eff96856780 -1 Falling back to public interface 2026-02-21T12:06:29.193 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-21T12:06:29.193 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:06:29.193 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:06:29.194 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:06:29.194 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:06:29.194 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:06:29.194 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:06:29.195 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:06:29.195 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:06:29.195 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:06:29.423 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:06:29.427 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:06:29.448+0000 7eff96856780 -1 osd.0 28 log_to_monitors true 2026-02-21T12:06:30.425 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:06:30.425 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:06:30.425 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:06:30.426 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:06:30.426 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:06:30.426 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:06:30.655 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/1783965591,v1:127.0.0.1:6801/1783965591] [v2:127.0.0.1:6802/1783965591,v1:127.0.0.1:6803/1783965591] exists,up 88e4c84b-df35-45e5-ad58-d9d691d7ffd7 2026-02-21T12:06:30.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 2 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:06:30.659 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-21T12:06:30.660 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:06:30.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:06:30.661 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-21T12:06:30.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-21T12:06:30.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:06:30.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:06:30.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:06:30.676 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:06:30.696+0000 7f5a6bdd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:06:30.677 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:06:30.698+0000 7f5a6bdd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:06:30.678 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:06:30.699+0000 7f5a6bdd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:06:30.824 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:06:30.844+0000 7f5a6bdd6780 -1 Falling back to public interface 2026-02-21T12:06:30.890 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-21T12:06:30.890 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:06:30.890 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:06:30.890 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:06:30.890 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:06:30.890 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:06:30.891 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:06:30.891 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:06:30.891 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:06:30.891 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:06:31.119 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:06:31.140 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:06:31.160+0000 7f5a6bdd6780 -1 osd.2 28 log_to_monitors true 2026-02-21T12:06:32.120 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:06:32.121 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:06:32.121 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:06:32.122 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:06:32.122 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:06:32.122 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:06:32.350 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 31 last_clean_interval [14,28) [v2:127.0.0.1:6810/897210722,v1:127.0.0.1:6811/897210722] [v2:127.0.0.1:6812/897210722,v1:127.0.0.1:6813/897210722] exists,up af9fb76e-a465-4e68-abc1-80968c90b791 2026-02-21T12:06:32.351 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:06:32.351 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:06:32.352 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:06:32.352 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-21T12:06:32.352 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.0 2026-02-21T12:06:32.599 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already in. 2026-02-21T12:06:32.606 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-21T12:06:32.606 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.2 2026-02-21T12:06:32.900 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already in. 2026-02-21T12:06:32.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-21T12:06:32.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: wait_for_clean 2026-02-21T12:06:32.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:06:32.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:06:32.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:06:32.908 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-21T12:06:32.909 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:06:32.909 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:06:32.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:06:32.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:06:32.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:06:32.960 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-21T12:06:32.961 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:06:32.961 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:06:32.961 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:06:32.961 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:06:32.961 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:06:33.189 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:06:33.189 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:06:33.189 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:06:33.189 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:06:33.190 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:06:33.190 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:06:33.258 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=150323855363 2026-02-21T12:06:33.258 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 150323855363 2026-02-21T12:06:33.258 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-150323855363' 2026-02-21T12:06:33.259 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:06:33.259 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:06:33.307 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq= 2026-02-21T12:06:33.307 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: true 2026-02-21T12:06:33.308 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z '' 2026-02-21T12:06:33.308 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2289: flush_pg_stats: continue 2026-02-21T12:06:33.308 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:06:33.308 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:06:33.374 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=163208757251 2026-02-21T12:06:33.374 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 163208757251 2026-02-21T12:06:33.374 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-150323855363 2-163208757251' 2026-02-21T12:06:33.375 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:06:33.375 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-150323855363 2026-02-21T12:06:33.375 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:06:33.375 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:06:33.376 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-150323855363 2026-02-21T12:06:33.376 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:06:33.377 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=150323855363 2026-02-21T12:06:33.377 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-21T12:06:33.378 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 150323855363 2026-02-21T12:06:33.378 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:06:33.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 1 -lt 150323855363 2026-02-21T12:06:33.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:06:34.606 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:06:34.607 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:06:34.833 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-21T12:06:34.834 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:06:34.834 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-163208757251 2026-02-21T12:06:34.834 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:06:34.835 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:06:34.835 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-163208757251 2026-02-21T12:06:34.835 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:06:34.837 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=163208757251 2026-02-21T12:06:34.837 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-21T12:06:34.837 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 163208757251 2026-02-21T12:06:34.837 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:06:35.068 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-21T12:06:35.069 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:06:35.069 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:35.069 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:35.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:06:35.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:06:35.386 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:06:35.386 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:06:35.387 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:06:35.387 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:06:35.387 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:06:35.387 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:06:35.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:06:35.612 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:06:35.612 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:35.613 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:35.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:06:35.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-21T12:06:35.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-21T12:06:35.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-21T12:06:35.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:06:35.932 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-21T12:06:36.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:06:36.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:06:36.032 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:06:36.032 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:06:36.033 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:06:36.033 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:06:36.033 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:06:36.033 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:06:36.262 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:06:36.262 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:06:36.262 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:36.263 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:36.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:06:36.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:06:36.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:06:36.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:06:36.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:06:36.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:06:36.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:06:36.585 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:06:36.585 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:06:36.901 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:06:36.902 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:06:36.902 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-21T12:06:36.902 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:06:36.902 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-21T12:06:37.103 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:06:37.103 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:06:37.103 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:06:37.103 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:06:37.103 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:06:37.103 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:06:37.104 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:06:37.104 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:06:37.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:06:37.331 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:06:37.331 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:37.331 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:37.650 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:06:37.650 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:06:37.650 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:06:37.651 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:06:37.651 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:06:37.651 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:06:37.651 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:06:37.652 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:06:37.652 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:06:37.975 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:06:37.975 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:06:37.975 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-21T12:06:37.975 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:06:37.975 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-21T12:06:38.376 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:06:38.376 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:06:38.376 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:06:38.376 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:06:38.377 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:06:38.377 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:06:38.377 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:06:38.377 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:06:38.603 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:06:38.603 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:06:38.603 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:38.603 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:38.914 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:06:38.914 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:06:38.914 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:06:38.915 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:06:38.915 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:06:38.915 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:06:38.915 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:06:38.915 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:06:38.915 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:06:39.228 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:06:39.228 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:06:39.228 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-21T12:06:39.228 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:06:39.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-21T12:06:40.030 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:06:40.030 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:06:40.030 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:06:40.031 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:06:40.031 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:06:40.031 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:06:40.031 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:06:40.032 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:06:40.254 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:06:40.255 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:06:40.255 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:40.255 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:40.566 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:06:40.566 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:06:40.567 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:06:40.567 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:06:40.567 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:06:40.567 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:06:40.567 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:06:40.567 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:06:40.567 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:06:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:06:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:06:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-21T12:06:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:06:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-21T12:06:42.479 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:06:42.479 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:06:42.480 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:06:42.480 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:06:42.480 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:06:42.480 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:06:42.480 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:06:42.480 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:06:42.707 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:06:42.707 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:06:42.708 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:42.708 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:43.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:06:43.023 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:06:43.023 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:06:43.023 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:06:43.023 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:06:43.023 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:06:43.023 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:06:43.023 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:06:43.023 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:06:43.334 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:06:43.335 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:06:43.335 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-21T12:06:43.335 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:06:43.335 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-21T12:06:46.536 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:06:46.536 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:06:46.536 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:06:46.536 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:06:46.537 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:06:46.537 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:06:46.537 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:06:46.537 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:06:46.764 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:06:46.765 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:06:46.765 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:46.765 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:47.077 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:06:47.077 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:06:47.077 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:06:47.077 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:06:47.078 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:06:47.078 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:06:47.078 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:06:47.078 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:06:47.078 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:06:47.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:06:47.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:06:47.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-21T12:06:47.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:06:47.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-21T12:06:53.791 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:06:53.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:06:53.792 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:06:53.792 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:06:53.792 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:06:53.792 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:06:53.792 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:06:53.793 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:06:54.016 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:06:54.017 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:06:54.017 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:06:54.017 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:06:54.334 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:06:54.334 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:06:54.334 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:06:54.335 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:06:54.335 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:06:54.335 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:06:54.335 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:06:54.335 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:06:54.335 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:06:54.648 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:06:54.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:06:54.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-21T12:06:54.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:06:54.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-21T12:07:01.949 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:07:01.949 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:07:01.950 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:07:01.950 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:07:01.951 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:07:01.951 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:07:01.951 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:07:01.951 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:07:02.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:07:02.181 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:07:02.181 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:07:02.181 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:07:02.499 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:07:02.499 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:07:02.499 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:07:02.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:07:02.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:07:02.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:07:02.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:07:02.500 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:07:02.500 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:07:02.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:07:02.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:07:02.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-21T12:07:02.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-21T12:07:03.124 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:07:03.124 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_fingerprint": "549c31a5-3d74-47e6-ab2d-584f3db6056e", 2026-02-21T12:07:03.125 INFO:tasks.workunit.client.0.trial058.stdout: "version": "20.3.0-5397-gf7273f30", 2026-02-21T12:07:03.125 INFO:tasks.workunit.client.0.trial058.stdout: "commit": "f7273f3049146bdd7fa7b4a400114872a50228e9", 2026-02-21T12:07:03.125 INFO:tasks.workunit.client.0.trial058.stdout: "timestamp": "2026-02-21T12:07:03.144691+0000", 2026-02-21T12:07:03.125 INFO:tasks.workunit.client.0.trial058.stdout: "tag": "", 2026-02-21T12:07:03.125 INFO:tasks.workunit.client.0.trial058.stdout: "health": { 2026-02-21T12:07:03.125 INFO:tasks.workunit.client.0.trial058.stdout: "status": "HEALTH_WARN", 2026-02-21T12:07:03.125 INFO:tasks.workunit.client.0.trial058.stdout: "checks": { 2026-02-21T12:07:03.125 INFO:tasks.workunit.client.0.trial058.stdout: "OSDMAP_FLAGS": { 2026-02-21T12:07:03.125 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:07:03.125 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:07:03.125 INFO:tasks.workunit.client.0.trial058.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-21T12:07:03.126 INFO:tasks.workunit.client.0.trial058.stdout: "count": 17 2026-02-21T12:07:03.126 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.126 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [], 2026-02-21T12:07:03.126 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:07:03.126 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.126 INFO:tasks.workunit.client.0.trial058.stdout: "OSD_DOWN": { 2026-02-21T12:07:03.126 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:07:03.126 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:07:03.126 INFO:tasks.workunit.client.0.trial058.stdout: "message": "1 osds down", 2026-02-21T12:07:03.126 INFO:tasks.workunit.client.0.trial058.stdout: "count": 1 2026-02-21T12:07:03.126 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.126 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:07:03.127 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.127 INFO:tasks.workunit.client.0.trial058.stdout: "message": "osd.1 (root=default,host=trial058) is down" 2026-02-21T12:07:03.127 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.127 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.127 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:07:03.127 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.127 INFO:tasks.workunit.client.0.trial058.stdout: "PG_DEGRADED": { 2026-02-21T12:07:03.127 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:07:03.127 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:07:03.127 INFO:tasks.workunit.client.0.trial058.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-21T12:07:03.127 INFO:tasks.workunit.client.0.trial058.stdout: "count": 1 2026-02-21T12:07:03.128 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.128 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:07:03.128 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.128 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:07:03.128 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.128 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.128 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:07:03.128 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.128 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.128 INFO:tasks.workunit.client.0.trial058.stdout: "mutes": [] 2026-02-21T12:07:03.128 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.128 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_first_committed": 1, 2026-02-21T12:07:03.129 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_last_committed": 1, 2026-02-21T12:07:03.129 INFO:tasks.workunit.client.0.trial058.stdout: "monmap": { 2026-02-21T12:07:03.129 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:07:03.129 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:07:03.129 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:05:53.443603Z", 2026-02-21T12:07:03.129 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:05:53.443603Z", 2026-02-21T12:07:03.129 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release": 20, 2026-02-21T12:07:03.129 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-21T12:07:03.129 INFO:tasks.workunit.client.0.trial058.stdout: "election_strategy": 1, 2026-02-21T12:07:03.129 INFO:tasks.workunit.client.0.trial058.stdout: "disallowed_leaders": "", 2026-02-21T12:07:03.129 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": false, 2026-02-21T12:07:03.129 INFO:tasks.workunit.client.0.trial058.stdout: "tiebreaker_mon": "", 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "removed_ranks": "", 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "features": { 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "persistent": [ 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "kraken", 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "luminous", 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "mimic", 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap-prune", 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "nautilus", 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "octopus", 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "pacific", 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "elector-pinging", 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "quincy", 2026-02-21T12:07:03.130 INFO:tasks.workunit.client.0.trial058.stdout: "reef", 2026-02-21T12:07:03.131 INFO:tasks.workunit.client.0.trial058.stdout: "squid", 2026-02-21T12:07:03.131 INFO:tasks.workunit.client.0.trial058.stdout: "tentacle", 2026-02-21T12:07:03.131 INFO:tasks.workunit.client.0.trial058.stdout: "nvmeof_beacon_diff" 2026-02-21T12:07:03.131 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.131 INFO:tasks.workunit.client.0.trial058.stdout: "optional": [] 2026-02-21T12:07:03.131 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.131 INFO:tasks.workunit.client.0.trial058.stdout: "mons": [ 2026-02-21T12:07:03.131 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.131 INFO:tasks.workunit.client.0.trial058.stdout: "rank": 0, 2026-02-21T12:07:03.131 INFO:tasks.workunit.client.0.trial058.stdout: "name": "a", 2026-02-21T12:07:03.131 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:07:03.131 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115", 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 0 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115/0", 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: "priority": 0, 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 0, 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: "time_added": "2026-02-21T12:05:53:443599+0000", 2026-02-21T12:07:03.132 INFO:tasks.workunit.client.0.trial058.stdout: "crush_location": [] 2026-02-21T12:07:03.133 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.133 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.133 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.133 INFO:tasks.workunit.client.0.trial058.stdout: "quorum": [ 2026-02-21T12:07:03.133 INFO:tasks.workunit.client.0.trial058.stdout: 0 2026-02-21T12:07:03.133 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.133 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap": { 2026-02-21T12:07:03.133 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 41, 2026-02-21T12:07:03.133 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:07:03.133 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:05:53.478334+0000", 2026-02-21T12:07:03.133 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:06:32.956978+0000", 2026-02-21T12:07:03.133 INFO:tasks.workunit.client.0.trial058.stdout: "last_up_change": "2026-02-21T12:06:31.322944+0000", 2026-02-21T12:07:03.134 INFO:tasks.workunit.client.0.trial058.stdout: "last_in_change": "2026-02-21T12:06:32.855553+0000", 2026-02-21T12:07:03.134 INFO:tasks.workunit.client.0.trial058.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-21T12:07:03.134 INFO:tasks.workunit.client.0.trial058.stdout: "flags_num": 5800384, 2026-02-21T12:07:03.134 INFO:tasks.workunit.client.0.trial058.stdout: "flags_set": [ 2026-02-21T12:07:03.134 INFO:tasks.workunit.client.0.trial058.stdout: "nodown", 2026-02-21T12:07:03.134 INFO:tasks.workunit.client.0.trial058.stdout: "noin", 2026-02-21T12:07:03.134 INFO:tasks.workunit.client.0.trial058.stdout: "noout", 2026-02-21T12:07:03.134 INFO:tasks.workunit.client.0.trial058.stdout: "pglog_hardlimit", 2026-02-21T12:07:03.134 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snapdirs", 2026-02-21T12:07:03.134 INFO:tasks.workunit.client.0.trial058.stdout: "recovery_deletes", 2026-02-21T12:07:03.134 INFO:tasks.workunit.client.0.trial058.stdout: "sortbitwise" 2026-02-21T12:07:03.134 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.135 INFO:tasks.workunit.client.0.trial058.stdout: "crush_version": 9, 2026-02-21T12:07:03.135 INFO:tasks.workunit.client.0.trial058.stdout: "full_ratio": 0.99000000953674316, 2026-02-21T12:07:03.135 INFO:tasks.workunit.client.0.trial058.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-21T12:07:03.135 INFO:tasks.workunit.client.0.trial058.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-21T12:07:03.135 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_snapshot": "", 2026-02-21T12:07:03.135 INFO:tasks.workunit.client.0.trial058.stdout: "pool_max": 1, 2026-02-21T12:07:03.135 INFO:tasks.workunit.client.0.trial058.stdout: "max_osd": 3, 2026-02-21T12:07:03.135 INFO:tasks.workunit.client.0.trial058.stdout: "require_min_compat_client": "luminous", 2026-02-21T12:07:03.135 INFO:tasks.workunit.client.0.trial058.stdout: "min_compat_client": "jewel", 2026-02-21T12:07:03.135 INFO:tasks.workunit.client.0.trial058.stdout: "require_osd_release": "tentacle", 2026-02-21T12:07:03.135 INFO:tasks.workunit.client.0.trial058.stdout: "allow_crimson": false, 2026-02-21T12:07:03.135 INFO:tasks.workunit.client.0.trial058.stdout: "pools": [ 2026-02-21T12:07:03.136 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.136 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:07:03.136 INFO:tasks.workunit.client.0.trial058.stdout: "pool_name": "test", 2026-02-21T12:07:03.136 INFO:tasks.workunit.client.0.trial058.stdout: "create_time": "2026-02-21T12:06:01.860910+0000", 2026-02-21T12:07:03.136 INFO:tasks.workunit.client.0.trial058.stdout: "flags": 1, 2026-02-21T12:07:03.136 INFO:tasks.workunit.client.0.trial058.stdout: "flags_names": "hashpspool", 2026-02-21T12:07:03.136 INFO:tasks.workunit.client.0.trial058.stdout: "type": 1, 2026-02-21T12:07:03.136 INFO:tasks.workunit.client.0.trial058.stdout: "size": 3, 2026-02-21T12:07:03.136 INFO:tasks.workunit.client.0.trial058.stdout: "min_size": 2, 2026-02-21T12:07:03.136 INFO:tasks.workunit.client.0.trial058.stdout: "crush_rule": 0, 2026-02-21T12:07:03.136 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_count": 0, 2026-02-21T12:07:03.136 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_target": 0, 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_barrier": 0, 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "is_stretch_pool": false, 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "object_hash": 2, 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "pg_autoscale_mode": "off", 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num": 1, 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num": 1, 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num_target": 1, 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_target": 1, 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_pending": 1, 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "last_pg_merge_meta": { 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "source_pgid": "0.0", 2026-02-21T12:07:03.137 INFO:tasks.workunit.client.0.trial058.stdout: "ready_epoch": 0, 2026-02-21T12:07:03.138 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_started": 0, 2026-02-21T12:07:03.138 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": 0, 2026-02-21T12:07:03.138 INFO:tasks.workunit.client.0.trial058.stdout: "source_version": "0'0", 2026-02-21T12:07:03.138 INFO:tasks.workunit.client.0.trial058.stdout: "target_version": "0'0" 2026-02-21T12:07:03.138 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.138 INFO:tasks.workunit.client.0.trial058.stdout: "last_change": "28", 2026-02-21T12:07:03.138 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend": "0", 2026-02-21T12:07:03.138 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-21T12:07:03.138 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_preluminous": "0", 2026-02-21T12:07:03.138 INFO:tasks.workunit.client.0.trial058.stdout: "auid": 0, 2026-02-21T12:07:03.138 INFO:tasks.workunit.client.0.trial058.stdout: "snap_mode": "selfmanaged", 2026-02-21T12:07:03.138 INFO:tasks.workunit.client.0.trial058.stdout: "snap_seq": 0, 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "snap_epoch": 0, 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "pool_snaps": [], 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps": "[]", 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_bytes": 0, 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_objects": 0, 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "tiers": [], 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "tier_of": -1, 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "read_tier": -1, 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "write_tier": -1, 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "cache_mode": "none", 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_bytes": 0, 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_objects": 0, 2026-02-21T12:07:03.139 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_flush_age": 0, 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_evict_age": 0, 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profile": "", 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_params": { 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: "type": "none" 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_period": 0, 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_count": 0, 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: "use_gmt_hitset": true, 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: "min_read_recency_for_promote": 0, 2026-02-21T12:07:03.140 INFO:tasks.workunit.client.0.trial058.stdout: "min_write_recency_for_promote": 0, 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_grade_decay_rate": 0, 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_search_last_n": 0, 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "grade_table": [], 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "stripe_width": 0, 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "expected_num_objects": 0, 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "fast_read": false, 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "nonprimary_shards": "{}", 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "options": {}, 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "application_metadata": {}, 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "read_balance": { 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "score_type": "Fair distribution", 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "score_acting": 2.9900000095367432, 2026-02-21T12:07:03.141 INFO:tasks.workunit.client.0.trial058.stdout: "score_stable": 2.9900000095367432, 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: "optimal_score": 0.67000001668930054, 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: "raw_score_acting": 2, 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: "raw_score_stable": 2, 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity_weighted": 1, 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: "average_primary_affinity": 1, 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: "average_primary_affinity_weighted": 1 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: "osds": [ 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:07:03.142 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "88e4c84b-df35-45e5-ad58-d9d691d7ffd7", 2026-02-21T12:07:03.143 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:07:03.143 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:07:03.143 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:07:03.143 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:07:03.143 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 5, 2026-02-21T12:07:03.143 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 28, 2026-02-21T12:07:03.143 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 35, 2026-02-21T12:07:03.143 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 40, 2026-02-21T12:07:03.143 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 29, 2026-02-21T12:07:03.143 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:07:03.143 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:07:03.143 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6800", 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1783965591 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6801", 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1783965591 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.144 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6802", 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1783965591 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6803", 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1783965591 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.145 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6806", 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1783965591 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6807", 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1783965591 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.146 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6804", 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1783965591 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6805", 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1783965591 2026-02-21T12:07:03.147 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.148 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.148 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.148 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6801/1783965591", 2026-02-21T12:07:03.148 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6803/1783965591", 2026-02-21T12:07:03.148 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1783965591", 2026-02-21T12:07:03.148 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1783965591", 2026-02-21T12:07:03.148 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:07:03.148 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:07:03.148 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:07:03.148 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.148 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.148 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "ca7b3c07-e0ce-443d-bdc4-b13f31d94275", 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "up": 0, 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 0, 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 0, 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 9, 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 22, 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 30, 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:07:03.149 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 4177717301 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 4177717301 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.150 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 4177717301 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 4177717301 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.151 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 4177717301 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 4177717301 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.152 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 4177717301 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 4177717301 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.153 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/4177717301", 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/4177717301", 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4177717301", 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4177717301", 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: "exists" 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "af9fb76e-a465-4e68-abc1-80968c90b791", 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:07:03.154 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 14, 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 28, 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 38, 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 0, 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 31, 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 897210722 2026-02-21T12:07:03.155 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 897210722 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 897210722 2026-02-21T12:07:03.156 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 897210722 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 897210722 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.157 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 897210722 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 897210722 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:07:03.158 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 897210722 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/897210722", 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/897210722", 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/897210722", 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/897210722", 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: "osd_xinfo": [ 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.159 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:06:27.507355+0000", 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:05:55.936917+0000", 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:06:27.813080+0000", 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:07:03.160 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:05:57.973969+0000", 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:06:28.106047+0000", 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:06:00.525659+0000", 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap": [], 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_items": [], 2026-02-21T12:07:03.161 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_primaries": [], 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "pg_temp": [], 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "primary_temp": [], 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "blocklist": {}, 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "range_blocklist": {}, 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profiles": { 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "default": { 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "k": "2", 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "m": "2", 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "plugin": "isa", 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "technique": "reed_sol_van" 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps_queue": [], 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "new_removed_snaps": [], 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "new_purged_snaps": [], 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "crush_node_flags": {}, 2026-02-21T12:07:03.162 INFO:tasks.workunit.client.0.trial058.stdout: "device_class_flags": {}, 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": { 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_enabled": false, 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_bucket_count": 0, 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "degraded_stretch_mode": 0, 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "recovering_stretch_mode": 0, 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_bucket": 0 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "osd_metadata": [ 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6802/1783965591,v1:127.0.0.1:6803/1783965591]", 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:07:03.163 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:07:03.164 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:05:54.195636Z", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6800/1783965591,v1:127.0.0.1:6801/1783965591]", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1783965591,v1:127.0.0.1:6807/1783965591]", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1783965591,v1:127.0.0.1:6805/1783965591]", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:07:03.165 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/0", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/4177717301,v1:127.0.0.1:6813/4177717301]", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:07:03.166 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:05:56.107985Z", 2026-02-21T12:07:03.167 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/4177717301,v1:127.0.0.1:6811/4177717301]", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4177717301,v1:127.0.0.1:6817/4177717301]", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4177717301,v1:127.0.0.1:6815/4177717301]", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:07:03.168 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/1", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/897210722,v1:127.0.0.1:6813/897210722]", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:07:03.169 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:05:58.705906Z", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:07:03.170 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/897210722,v1:127.0.0.1:6811/897210722]", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/897210722,v1:127.0.0.1:6817/897210722]", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/897210722,v1:127.0.0.1:6815/897210722]", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/2", 2026-02-21T12:07:03.171 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_clean_epochs": { 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: "min_last_epoch_clean": 0, 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": { 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: "per_pool": [] 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: "osd_epochs": [ 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 35 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 38 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.172 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_first_committed": 1, 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_last_committed": 41, 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "crushmap": { 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "devices": [ 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.0", 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.1", 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.2", 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "types": [ 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 0, 2026-02-21T12:07:03.173 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd" 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: "name": "host" 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 2, 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: "name": "chassis" 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 3, 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: "name": "rack" 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 4, 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: "name": "row" 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 5, 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pdu" 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 6, 2026-02-21T12:07:03.174 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pod" 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 7, 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: "name": "room" 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 8, 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: "name": "datacenter" 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 9, 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: "name": "zone" 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 10, 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: "name": "region" 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: "name": "root" 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.175 INFO:tasks.workunit.client.0.trial058.stdout: "buckets": [ 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "id": -1, 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default", 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "id": -2, 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default~ssd", 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:07:03.176 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058", 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:07:03.177 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058~ssd", 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:07:03.178 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "rules": [ 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "rule_id": 0, 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "rule_name": "replicated_rule", 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "type": 1, 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "steps": [ 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "op": "take", 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "item": -1, 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "item_name": "default" 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "op": "choose_firstn", 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "num": 0, 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "type": "osd" 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: "op": "emit" 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.179 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: "tunables": { 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_tries": 0, 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_fallback_tries": 0, 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: "choose_total_tries": 50, 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_descend_once": 1, 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_vary_r": 1, 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_stable": 1, 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: "msr_descents": 100, 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: "msr_collision_tries": 100, 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stderr:report 1086633250 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: "straw_calc_version": 1, 2026-02-21T12:07:03.180 INFO:tasks.workunit.client.0.trial058.stdout: "allowed_bucket_algs": 54, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "profile": "jewel", 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "optimal_tunables": 1, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "legacy_tunables": 0, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "minimum_required_version": "jewel", 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables": 1, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables2": 1, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "has_v2_rules": 0, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables3": 1, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "has_v3_rules": 0, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "has_v4_buckets": 1, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables5": 1, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "has_v5_rules": 0, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "has_msr_rules": 0 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "choose_args": {} 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "fsmap": { 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "btime": "2026-02-21T12:05:53:478106+0000", 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "default_fscid": -1, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "compat": { 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "compat": {}, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "ro_compat": {}, 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "incompat": { 2026-02-21T12:07:03.181 INFO:tasks.workunit.client.0.trial058.stdout: "feature_1": "base v0.20", 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "feature_2": "client writeable ranges", 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "feature_3": "default file layouts on dirs", 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "feature_4": "dir inode in separate object", 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "feature_5": "mds uses versioned encoding", 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "feature_8": "no anchor table", 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "feature_9": "file layout v2", 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "feature_10": "snaprealm v2", 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "feature_11": "minor log segments", 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "feature_12": "quiesce subvolumes" 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "feature_flags": { 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "enable_multiple": true, 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "ever_enabled_multiple": true 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "standbys": [], 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "filesystems": [] 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_first_committed": 1, 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_last_committed": 1, 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "auth": { 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 5, 2026-02-21T12:07:03.182 INFO:tasks.workunit.client.0.trial058.stdout: "num_secrets": 3 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 1, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_active": 1, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_unknown": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_osd": 3, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "pool_sum": { 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 51200, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 100, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 300, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 100, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 100, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 100, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 100, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:07:03.183 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:07:03.184 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 0, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 0, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 16, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 16, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "up": 2, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 2, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 0 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum": { 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 3, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 83884, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2104, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 24, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 81703, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314488916, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:07:03.185 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322036649984, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2154496, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 428864, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 25402, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 83664070 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 1, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum_by_class": { 2026-02-21T12:07:03.186 INFO:tasks.workunit.client.0.trial058.stdout: "ssd": { 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 3, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 83884, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2104, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 24, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 81703, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314488916, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322036649984, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2154496, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 428864, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 25402, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 83664070 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 1, 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:07:03.187 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "pool_stats": [ 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": 1, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 1, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 51200, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 100, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 0, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 300, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 100, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 100, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:07:03.188 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 100, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 100, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.189 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 1228800, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 153600, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 16, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 16, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "up": 2, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 2, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 3 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "osd_stats": [ 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 150323855369 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 38654705676 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:07:03.190 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 163208757257 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_state": [ 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "state": "active+undersized+degraded", 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "num": 1 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "pool_pg_unavailable_map": [ 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": "1", 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "pgs": [] 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_osd": [ 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 1, 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 1, 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 1, 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:07:03.191 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 0, 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": [ 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": {} 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "servicemap": { 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 3, 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:06:59.701330+0000", 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "services": { 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "osd": { 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "daemons": { 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "summary": "", 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "0": { 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "start_epoch": 0, 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "start_stamp": "0.000000", 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "gid": 0, 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "metadata": {}, 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "task_status": {} 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "2": { 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "start_epoch": 0, 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "start_stamp": "0.000000", 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "gid": 0, 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "metadata": {}, 2026-02-21T12:07:03.192 INFO:tasks.workunit.client.0.trial058.stdout: "task_status": {} 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_first_committed": 1, 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_last_committed": 35, 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: "logm_first_committed": 1, 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: "logm_last_committed": 216, 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: "paxos": { 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 302, 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: "last_pn": 0, 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: "accepted_pn": 0 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: expr 2 + 2 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: objname=existing_4 2026-02-21T12:07:03.193 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:151: TEST_divergent: echo 'writing non-divergent object existing_4' 2026-02-21T12:07:03.194 INFO:tasks.workunit.client.0.trial058.stdout:writing non-divergent object existing_4 2026-02-21T12:07:03.194 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:152: TEST_divergent: ceph pg dump pgs 2026-02-21T12:07:03.348 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:07:03.348 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:06:32.959398+0000 28'100 41:130 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T16:08:03.596960+0000 0 0 2026-02-21T12:07:03.348 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:07:03.348 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:07:03.349 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:07:03.355 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: dd if=/dev/urandom bs=1000 count=1 2026-02-21T12:07:03.355 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: rados -p test put existing_4 - 2026-02-21T12:07:03.356 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records in 2026-02-21T12:07:03.356 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records out 2026-02-21T12:07:03.356 INFO:tasks.workunit.client.0.trial058.stderr:1000 bytes (1.0 kB) copied, 2.0699e-05 s, 48.3 MB/s 2026-02-21T12:07:03.375 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:157: TEST_divergent: echo 'delay recovery' 2026-02-21T12:07:03.376 INFO:tasks.workunit.client.0.trial058.stdout:delay recovery 2026-02-21T12:07:03.376 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:158: TEST_divergent: ceph pg dump pgs 2026-02-21T12:07:03.595 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:07:03.595 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:06:32.959398+0000 28'100 41:130 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T16:08:03.596960+0000 0 0 2026-02-21T12:07:03.595 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:07:03.595 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:07:03.595 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:07:03.602 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-21T12:07:03.603 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.0 2026-02-21T12:07:03.604 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-21T12:07:03.604 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-21T12:07:03.604 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:07:03.604 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:03.604 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:03.604 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.0.asok 2026-02-21T12:07:03.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-21T12:07:03.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.0.asok set_recovery_delay 100000 2026-02-21T12:07:03.647 INFO:tasks.workunit.client.0.trial058.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-21T12:07:03.652 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-21T12:07:03.652 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.2 2026-02-21T12:07:03.652 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-21T12:07:03.652 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-21T12:07:03.653 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:07:03.653 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:03.653 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:03.653 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.2.asok 2026-02-21T12:07:03.654 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-21T12:07:03.654 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.2.asok set_recovery_delay 100000 2026-02-21T12:07:03.695 INFO:tasks.workunit.client.0.trial058.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-21T12:07:03.698 INFO:tasks.workunit.client.0.trial058.stdout:revive divergent 1 2026-02-21T12:07:03.699 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:165: TEST_divergent: echo 'revive divergent 1' 2026-02-21T12:07:03.699 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:166: TEST_divergent: ceph pg dump pgs 2026-02-21T12:07:03.915 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:07:03.915 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:06:32.959398+0000 28'100 41:130 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T16:08:03.596960+0000 0 0 2026-02-21T12:07:03.915 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:07:03.915 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:07:03.916 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:07:03.922 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:167: TEST_divergent: ceph osd set noup 2026-02-21T12:07:04.239 INFO:tasks.workunit.client.0.trial058.stderr:noup is set 2026-02-21T12:07:04.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:168: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-21T12:07:04.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:07:04.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:07:04.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-21T12:07:04.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:07:04.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-21T12:07:04.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:07:04.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:07:04.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:07:04.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:07:04.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-21T12:07:04.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-21T12:07:04.253 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:07:04.253 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:07:04.253 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:07:04.253 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:07:04.253 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:07:04.253 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:07:04.253 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:07:04.253 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:04.253 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:04.253 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:07:04.253 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:07:04.254 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:07:04.254 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:07:04.254 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:07:04.254 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:07:04.254 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:07:04.254 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:07:04.254 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:07:04.255 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:07:04.255 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:07:04.255 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-21T12:07:04.255 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-21T12:07:04.256 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:07:04.257 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:07:04.258 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-21T12:07:04.258 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-21T12:07:04.258 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:07:04.258 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:07:04.258 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:07:04.269 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:04.289+0000 7f50f8c58780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:04.270 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:04.290+0000 7f50f8c58780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:04.271 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:04.291+0000 7f50f8c58780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:04.416 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:04.436+0000 7f50f8c58780 -1 Falling back to public interface 2026-02-21T12:07:04.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-21T12:07:04.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:169: TEST_divergent: sleep 5 2026-02-21T12:07:04.742 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:04.762+0000 7f50f8c58780 -1 osd.1 28 log_to_monitors true 2026-02-21T12:07:09.482 INFO:tasks.workunit.client.0.trial058.stdout:delay recovery divergent 2026-02-21T12:07:09.482 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:171: TEST_divergent: echo 'delay recovery divergent' 2026-02-21T12:07:09.482 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:172: TEST_divergent: ceph pg dump pgs 2026-02-21T12:07:09.704 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:07:09.704 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:06:32.959398+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T16:08:03.596960+0000 0 0 2026-02-21T12:07:09.704 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:07:09.704 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:07:09.704 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:07:09.711 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: get_asok_path osd.1 2026-02-21T12:07:09.711 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-21T12:07:09.711 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-21T12:07:09.711 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:07:09.712 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:09.712 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:09.712 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.1.asok 2026-02-21T12:07:09.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: CEPH_ARGS= 2026-02-21T12:07:09.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.1.asok set_recovery_delay 100000 2026-02-21T12:07:09.756 INFO:tasks.workunit.client.0.trial058.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-21T12:07:09.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: ceph osd unset noup 2026-02-21T12:07:10.073 INFO:tasks.workunit.client.0.trial058.stderr:noup is unset 2026-02-21T12:07:10.085 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:177: TEST_divergent: wait_for_osd up 0 2026-02-21T12:07:10.085 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:07:10.085 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:07:10.085 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:07:10.086 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:07:10.086 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:07:10.086 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:07:10.087 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:07:10.087 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:07:10.087 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:07:10.315 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 35 up_thru 40 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/1783965591,v1:127.0.0.1:6801/1783965591] [v2:127.0.0.1:6802/1783965591,v1:127.0.0.1:6803/1783965591] exists,up 88e4c84b-df35-45e5-ad58-d9d691d7ffd7 2026-02-21T12:07:10.316 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:07:10.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:07:10.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:07:10.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:178: TEST_divergent: wait_for_osd up 1 2026-02-21T12:07:10.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:07:10.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:07:10.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:07:10.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:07:10.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:07:10.318 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:07:10.318 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:07:10.318 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:07:10.319 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:07:10.544 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/3398663414,v1:127.0.0.1:6819/3398663414] [v2:127.0.0.1:6820/3398663414,v1:127.0.0.1:6821/3398663414] exists,up ca7b3c07-e0ce-443d-bdc4-b13f31d94275 2026-02-21T12:07:10.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:07:10.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:07:10.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:07:10.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:179: TEST_divergent: wait_for_osd up 2 2026-02-21T12:07:10.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:07:10.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:07:10.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:07:10.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:07:10.547 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:07:10.547 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:07:10.547 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:07:10.548 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:07:10.548 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:07:10.772 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 31 last_clean_interval [14,28) [v2:127.0.0.1:6810/897210722,v1:127.0.0.1:6811/897210722] [v2:127.0.0.1:6812/897210722,v1:127.0.0.1:6813/897210722] exists,up af9fb76e-a465-4e68-abc1-80968c90b791 2026-02-21T12:07:10.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:07:10.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:07:10.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:07:10.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:181: TEST_divergent: ceph pg dump pgs 2026-02-21T12:07:10.987 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:07:10.987 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:06:32.959398+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T16:08:03.596960+0000 0 0 2026-02-21T12:07:10.987 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:07:10.988 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:07:10.988 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:07:10.994 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:182: TEST_divergent: echo 'wait for peering' 2026-02-21T12:07:10.994 INFO:tasks.workunit.client.0.trial058.stdout:wait for peering 2026-02-21T12:07:10.994 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:183: TEST_divergent: ceph pg dump pgs 2026-02-21T12:07:11.214 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:07:11.214 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:06:32.959398+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T16:08:03.596960+0000 0 0 2026-02-21T12:07:11.214 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:07:11.214 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:07:11.214 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:07:11.220 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:184: TEST_divergent: rados -p test put foo /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:07:11.241 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:186: TEST_divergent: echo 'killing divergent 1' 2026-02-21T12:07:11.241 INFO:tasks.workunit.client.0.trial058.stdout:killing divergent 1 2026-02-21T12:07:11.242 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:187: TEST_divergent: ceph pg dump pgs 2026-02-21T12:07:11.458 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:07:11.458 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:06:32.959398+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T16:08:03.596960+0000 0 0 2026-02-21T12:07:11.458 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:07:11.458 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:07:11.458 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:07:11.465 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:188: TEST_divergent: kill_daemons td/divergent-priors KILL osd.1 2026-02-21T12:07:11.465 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:07:11.465 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:07:11.465 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:07:11.466 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:07:11.466 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:07:11.572 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:07:11.572 INFO:tasks.workunit.client.0.trial058.stdout:reviving divergent 1 2026-02-21T12:07:11.572 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:190: TEST_divergent: echo 'reviving divergent 1' 2026-02-21T12:07:11.573 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:191: TEST_divergent: ceph pg dump pgs 2026-02-21T12:07:11.789 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:07:11.790 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:06:32.959398+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T16:08:03.596960+0000 0 0 2026-02-21T12:07:11.790 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:07:11.790 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:07:11.790 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:07:11.797 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:192: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:11.798 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-21T12:07:11.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-21T12:07:11.800 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:07:11.800 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:07:11.800 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-21T12:07:11.801 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-21T12:07:11.802 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:07:11.802 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:07:11.802 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:07:11.818 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:11.838+0000 7f63b5a27780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:11.819 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:11.839+0000 7f63b5a27780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:11.820 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:11.840+0000 7f63b5a27780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:11.963 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:11.984+0000 7f63b5a27780 -1 Falling back to public interface 2026-02-21T12:07:12.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-21T12:07:12.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:07:12.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:07:12.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:07:12.034 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:07:12.034 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:07:12.034 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:07:12.034 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:07:12.034 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:07:12.034 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:07:12.262 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/3398663414,v1:127.0.0.1:6819/3398663414] [v2:127.0.0.1:6820/3398663414,v1:127.0.0.1:6821/3398663414] exists,up ca7b3c07-e0ce-443d-bdc4-b13f31d94275 2026-02-21T12:07:12.263 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:07:12.263 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:07:12.263 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:07:12.263 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:194: TEST_divergent: sleep 20 2026-02-21T12:07:12.349 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:12.370+0000 7f63b5a27780 -1 osd.1 47 log_to_monitors true 2026-02-21T12:07:32.263 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:196: TEST_divergent: echo 'allowing recovery' 2026-02-21T12:07:32.263 INFO:tasks.workunit.client.0.trial058.stdout:allowing recovery 2026-02-21T12:07:32.263 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:197: TEST_divergent: ceph pg dump pgs 2026-02-21T12:07:32.481 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:07:32.482 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-21T12:07:13.454351+0000 47'102 51:159 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T17:45:17.846468+0000 0 0 2026-02-21T12:07:32.482 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:07:32.482 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:07:32.482 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:07:32.488 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-21T12:07:32.489 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-21T12:07:32.551 INFO:tasks.workunit.client.0.trial058.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-21T12:07:32.556 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-21T12:07:32.556 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-21T12:07:32.617 INFO:tasks.workunit.client.0.trial058.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-21T12:07:32.623 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-21T12:07:32.623 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-21T12:07:32.684 INFO:tasks.workunit.client.0.trial058.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-21T12:07:32.690 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:204: TEST_divergent: echo 'reading divergent objects' 2026-02-21T12:07:32.690 INFO:tasks.workunit.client.0.trial058.stdout:reading divergent objects 2026-02-21T12:07:32.690 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:205: TEST_divergent: ceph pg dump pgs 2026-02-21T12:07:32.907 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:07:32.907 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-21T12:07:13.454351+0000 47'102 51:159 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:06:01.886925+0000 0'0 2026-02-21T12:06:01.886925+0000 0 0 periodic scrub scheduled @ 2026-02-22T17:45:17.846468+0000 0 0 2026-02-21T12:07:32.907 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:07:32.907 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:07:32.907 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:07:32.915 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: expr 2 + 2 2026-02-21T12:07:32.916 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: seq 1 4 2026-02-21T12:07:32.916 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:07:32.916 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_1 td/divergent-priors/existing 2026-02-21T12:07:32.935 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:07:32.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_2 td/divergent-priors/existing 2026-02-21T12:07:32.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:07:32.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_3 td/divergent-priors/existing 2026-02-21T12:07:32.972 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:07:32.972 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_4 td/divergent-priors/existing 2026-02-21T12:07:32.991 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rm -f td/divergent-priors/existing 2026-02-21T12:07:32.992 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-21T12:07:32.993 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: grep _merge_object_divergent_entries td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-21T12:07:32.996 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:07:10.852+0000 7f50d64bc640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4530.0:1 2026-02-21T12:06:16.615016+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-21T12:07:32.996 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:07:10.852+0000 7f50d64bc640 20 _merge_object_divergent_entries: keeping 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4530.0:1 2026-02-21T12:06:16.615016+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-21T12:07:32.996 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:07:10.852+0000 7f50d64bc640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:07:32.996 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:07:10.852+0000 7f50d64bc640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 28'100 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-21T12:07:32.996 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:07:10.852+0000 7f50d64bc640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-21T12:07:32.996 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:07:10.852+0000 7f50d64bc640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-21T12:07:32.996 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:07:10.852+0000 7f50d64bc640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 28'101 2026-02-21T12:07:32.996 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:07:10.852+0000 7f50d64bc640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4530.0:1 2026-02-21T12:06:16.615016+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-21T12:07:32.996 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:07:10.852+0000 7f50d64bc640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-21T12:07:32.997 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-21T12:07:32.998 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: grep -q '_merge_object_divergent_entries.*cannot roll back, removing and adding to missing' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-21T12:07:33.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:219: TEST_divergent: echo success 2026-02-21T12:07:33.000 INFO:tasks.workunit.client.0.trial058.stdout:success 2026-02-21T12:07:33.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:221: TEST_divergent: rm -f /tmp/tmp.Uv04UgQ8SG 2026-02-21T12:07:33.001 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:222: TEST_divergent: delete_pool test 2026-02-21T12:07:33.001 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-21T12:07:33.001 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-21T12:07:33.273 INFO:tasks.workunit.client.0.trial058.stderr:pool 'test' does not exist 2026-02-21T12:07:33.280 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:223: TEST_divergent: kill_daemons td/divergent-priors 2026-02-21T12:07:33.281 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:07:33.281 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:07:33.281 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:07:33.281 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:07:33.281 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:07:38.595 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:07:38.595 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-21T12:07:38.595 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-21T12:07:38.595 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:07:38.595 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-21T12:07:38.595 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:07:38.595 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:07:38.595 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:07:38.596 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:07:38.596 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:07:38.601 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:07:38.601 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:07:38.602 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:07:38.602 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:07:38.603 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:07:38.603 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:07:38.603 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:07:38.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:07:38.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:07:38.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:07:38.605 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:07:38.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:07:38.606 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:07:38.606 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-21T12:07:38.619 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:07:38.619 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:38.619 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:38.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.43953 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:07:38.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:07:38.623 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:07:38.624 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:07:38.624 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:07:38.624 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:07:38.625 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:07:38.625 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:07:38.625 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:07:38.626 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:07:38.626 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:07:38.627 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:07:38.627 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:07:38.627 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:07:38.628 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:07:38.628 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-21T12:07:38.629 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:07:38.629 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:38.629 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:38.629 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.43953 2026-02-21T12:07:38.630 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:07:38.630 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:07:38.630 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-21T12:07:38.631 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-21T12:07:38.631 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:38.631 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:38.632 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.43953 2026-02-21T12:07:38.633 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-21T12:07:38.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-21T12:07:38.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-21T12:07:38.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-21T12:07:38.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_2 td/divergent-priors 2026-02-21T12:07:38.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:422: TEST_divergent_2: local dir=td/divergent-priors 2026-02-21T12:07:38.633 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: file_with_random_data 2026-02-21T12:07:38.633 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: file_with_random_data: local size_bytes=512 2026-02-21T12:07:38.634 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: mktemp 2026-02-21T12:07:38.635 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: local file=/tmp/tmp.yvksX6h33X 2026-02-21T12:07:38.635 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.yvksX6h33X bs=512 count=1 2026-02-21T12:07:38.635 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records in 2026-02-21T12:07:38.635 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records out 2026-02-21T12:07:38.635 INFO:tasks.workunit.client.0.trial058.stderr:512 bytes copied, 5.8309e-05 s, 8.8 MB/s 2026-02-21T12:07:38.635 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: file_with_random_data: printf %s /tmp/tmp.yvksX6h33X 2026-02-21T12:07:38.636 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: local dummyfile=/tmp/tmp.yvksX6h33X 2026-02-21T12:07:38.636 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: file_with_random_data 1000 2026-02-21T12:07:38.636 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: file_with_random_data: local size_bytes=1000 2026-02-21T12:07:38.636 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: mktemp 2026-02-21T12:07:38.637 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: local file=/tmp/tmp.6S0Ai3Bxnd 2026-02-21T12:07:38.637 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.6S0Ai3Bxnd bs=1000 count=1 2026-02-21T12:07:38.638 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records in 2026-02-21T12:07:38.638 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records out 2026-02-21T12:07:38.638 INFO:tasks.workunit.client.0.trial058.stderr:1000 bytes (1.0 kB) copied, 5.1467e-05 s, 19.4 MB/s 2026-02-21T12:07:38.638 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: file_with_random_data: printf %s /tmp/tmp.6S0Ai3Bxnd 2026-02-21T12:07:38.638 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: local dummyfile2=/tmp/tmp.6S0Ai3Bxnd 2026-02-21T12:07:38.638 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: local num_osds=3 2026-02-21T12:07:38.639 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: expr 3 - 1 2026-02-21T12:07:38.639 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: seq 0 2 2026-02-21T12:07:38.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: local 'osds=0 2026-02-21T12:07:38.640 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:07:38.640 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:07:38.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:430: TEST_divergent_2: run_mon td/divergent-priors a 2026-02-21T12:07:38.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-21T12:07:38.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-21T12:07:38.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-21T12:07:38.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-21T12:07:38.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-21T12:07:38.641 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-21T12:07:38.661 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-21T12:07:38.661 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:07:38.661 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:07:38.661 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:07:38.661 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:38.662 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:38.662 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:07:38.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-21T12:07:38.687 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-21T12:07:38.689 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-21T12:07:38.689 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:07:38.689 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:07:38.689 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-21T12:07:38.689 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-21T12:07:38.690 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:07:38.690 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:07:38.690 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:07:38.690 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:07:38.690 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:38.690 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:38.690 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-mon.a.asok 2026-02-21T12:07:38.690 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:07:38.690 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.43953/ceph-mon.a.asok config get fsid 2026-02-21T12:07:38.732 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-21T12:07:38.732 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:07:38.732 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:07:38.732 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-21T12:07:38.733 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-21T12:07:38.733 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:07:38.733 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:07:38.733 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:07:38.733 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:07:38.733 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:38.733 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:38.733 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-mon.a.asok 2026-02-21T12:07:38.734 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:07:38.734 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.43953/ceph-mon.a.asok config get mon_host 2026-02-21T12:07:38.774 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: run_mgr td/divergent-priors x 2026-02-21T12:07:38.775 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-21T12:07:38.775 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-21T12:07:38.775 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-21T12:07:38.775 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-21T12:07:38.775 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-21T12:07:38.775 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-21T12:07:38.875 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-21T12:07:38.875 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:07:38.875 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:07:38.876 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:07:38.876 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:38.876 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:38.876 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:07:38.876 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:07:38.877 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:07:38.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-21T12:07:38.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 0 2026-02-21T12:07:38.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-21T12:07:38.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:07:38.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-21T12:07:38.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:07:38.896 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=47b65e0c-dfc5-44b3-8760-5fe46ccd281a 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stdout:add osd0 47b65e0c-dfc5-44b3-8760-5fe46ccd281a 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 47b65e0c-dfc5-44b3-8760-5fe46ccd281a' 2026-02-21T12:07:38.898 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:07:38.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAKoJlpfHN6NxAAIKY+zseXN0edZ99uhuzlow== 2026-02-21T12:07:38.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAKoJlpfHN6NxAAIKY+zseXN0edZ99uhuzlow=="}' 2026-02-21T12:07:38.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 47b65e0c-dfc5-44b3-8760-5fe46ccd281a -i td/divergent-priors/0/new.json 2026-02-21T12:07:39.015 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:07:39.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-21T12:07:39.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAKoJlpfHN6NxAAIKY+zseXN0edZ99uhuzlow== --osd-uuid 47b65e0c-dfc5-44b3-8760-5fe46ccd281a 2026-02-21T12:07:39.042 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:39.062+0000 7f78f620c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:39.043 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:39.064+0000 7f78f620c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:39.044 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:39.065+0000 7f78f620c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:39.044 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:39.065+0000 7f78f620c780 -1 bdev(0x2b3ac00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-21T12:07:39.044 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:39.065+0000 7f78f620c780 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-21T12:07:39.468 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-21T12:07:39.468 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:07:39.469 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-21T12:07:39.469 INFO:tasks.workunit.client.0.trial058.stdout:adding osd0 key to auth repository 2026-02-21T12:07:39.469 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:07:39.575 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-21T12:07:39.575 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:07:39.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:07:39.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:07:39.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:07:39.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:07:39.594 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:39.615+0000 7ff221a25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:39.596 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:39.617+0000 7ff221a25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:39.597 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:39.618+0000 7ff221a25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:39.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-21T12:07:39.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:07:39.679 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:07:39.679 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:07:39.679 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:07:39.679 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:07:39.679 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:07:39.680 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:07:39.680 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:07:39.680 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:07:39.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:07:39.809 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:39.830+0000 7ff221a25780 -1 Falling back to public interface 2026-02-21T12:07:40.161 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:40.181+0000 7ff221a25780 -1 osd.0 0 log_to_monitors true 2026-02-21T12:07:40.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:07:40.779 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:07:40.779 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:07:40.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:07:40.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:07:40.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:07:40.878 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2962136260,v1:127.0.0.1:6801/2962136260] [v2:127.0.0.1:6802/2962136260,v1:127.0.0.1:6803/2962136260] exists,up 47b65e0c-dfc5-44b3-8760-5fe46ccd281a 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 1 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:40.879 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:07:40.880 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-21T12:07:40.881 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:07:40.881 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9c72da50-1daa-4602-ae45-087799931454 2026-02-21T12:07:40.881 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 9c72da50-1daa-4602-ae45-087799931454' 2026-02-21T12:07:40.881 INFO:tasks.workunit.client.0.trial058.stdout:add osd1 9c72da50-1daa-4602-ae45-087799931454 2026-02-21T12:07:40.882 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:07:40.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAMoJlpXxGVNhAAV0VT1asxsnYbT5OoF/xWBg== 2026-02-21T12:07:40.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAMoJlpXxGVNhAAV0VT1asxsnYbT5OoF/xWBg=="}' 2026-02-21T12:07:40.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9c72da50-1daa-4602-ae45-087799931454 -i td/divergent-priors/1/new.json 2026-02-21T12:07:41.001 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:07:41.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-21T12:07:41.010 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAMoJlpXxGVNhAAV0VT1asxsnYbT5OoF/xWBg== --osd-uuid 9c72da50-1daa-4602-ae45-087799931454 2026-02-21T12:07:41.029 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:41.050+0000 7f16aec1b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:41.031 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:41.051+0000 7f16aec1b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:41.031 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:41.052+0000 7f16aec1b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:41.032 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:41.052+0000 7f16aec1b780 -1 bdev(0x3774c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-21T12:07:41.032 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:41.052+0000 7f16aec1b780 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-21T12:07:41.351 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-21T12:07:41.351 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:07:41.351 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-21T12:07:41.352 INFO:tasks.workunit.client.0.trial058.stdout:adding osd1 key to auth repository 2026-02-21T12:07:41.352 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:07:41.672 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:07:41.673 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-21T12:07:41.673 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:07:41.673 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:07:41.673 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:07:41.673 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:07:41.691 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:41.711+0000 7f6ccee28780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:41.692 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:41.713+0000 7f6ccee28780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:41.693 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:41.713+0000 7f6ccee28780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:41.826 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:41.846+0000 7f6ccee28780 -1 Falling back to public interface 2026-02-21T12:07:41.902 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-21T12:07:41.902 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:07:41.902 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:07:41.902 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:07:41.903 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:07:41.903 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:07:41.903 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:07:41.903 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:07:41.904 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:07:41.904 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:07:42.122 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:42.143+0000 7f6ccee28780 -1 osd.1 0 log_to_monitors true 2026-02-21T12:07:42.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:07:43.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:07:43.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:07:43.135 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:07:43.136 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:07:43.136 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:07:43.136 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:07:43.363 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/699118437,v1:127.0.0.1:6811/699118437] [v2:127.0.0.1:6812/699118437,v1:127.0.0.1:6813/699118437] exists,up 9c72da50-1daa-4602-ae45-087799931454 2026-02-21T12:07:43.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:07:43.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:07:43.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:07:43.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-21T12:07:43.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 2 2026-02-21T12:07:43.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-21T12:07:43.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:07:43.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-21T12:07:43.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:07:43.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-21T12:07:43.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:07:43.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:07:43.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:07:43.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:07:43.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-21T12:07:43.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-21T12:07:43.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:07:43.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:07:43.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:07:43.369 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:07:43.369 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:07:43.369 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:07:43.369 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:07:43.369 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:07:43.369 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:07:43.369 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:07:43.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:07:43.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:07:43.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:07:43.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:07:43.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:07:43.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:07:43.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:07:43.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:07:43.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:07:43.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:07:43.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:07:43.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:07:43.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-21T12:07:43.370 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:07:43.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f3f7a802-ba4e-4713-b046-17267dbaaf6f 2026-02-21T12:07:43.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 f3f7a802-ba4e-4713-b046-17267dbaaf6f' 2026-02-21T12:07:43.371 INFO:tasks.workunit.client.0.trial058.stdout:add osd2 f3f7a802-ba4e-4713-b046-17267dbaaf6f 2026-02-21T12:07:43.371 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:07:43.378 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAPoJlpsGLMFxAAIfem13Sfp7HXIDXzQcRqsg== 2026-02-21T12:07:43.379 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAPoJlpsGLMFxAAIfem13Sfp7HXIDXzQcRqsg=="}' 2026-02-21T12:07:43.379 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f3f7a802-ba4e-4713-b046-17267dbaaf6f -i td/divergent-priors/2/new.json 2026-02-21T12:07:43.611 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:07:43.619 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-21T12:07:43.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAPoJlpsGLMFxAAIfem13Sfp7HXIDXzQcRqsg== --osd-uuid f3f7a802-ba4e-4713-b046-17267dbaaf6f 2026-02-21T12:07:43.639 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:43.659+0000 7f0658e41780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:43.641 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:43.660+0000 7f0658e41780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:43.642 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:43.661+0000 7f0658e41780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:43.642 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:43.661+0000 7f0658e41780 -1 bdev(0x3b2ec00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-21T12:07:43.642 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:43.662+0000 7f0658e41780 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-21T12:07:43.969 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-21T12:07:43.970 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:07:43.970 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-21T12:07:43.971 INFO:tasks.workunit.client.0.trial058.stdout:adding osd2 key to auth repository 2026-02-21T12:07:43.971 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:07:44.289 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-21T12:07:44.290 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:07:44.290 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:07:44.290 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:07:44.290 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:07:44.290 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:07:44.307 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:44.327+0000 7f84bcc83780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:44.309 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:44.328+0000 7f84bcc83780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:44.309 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:44.329+0000 7f84bcc83780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:07:44.438 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:44.457+0000 7f84bcc83780 -1 Falling back to public interface 2026-02-21T12:07:44.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-21T12:07:44.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:07:44.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:07:44.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:07:44.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:07:44.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:07:44.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:07:44.519 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:07:44.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:07:44.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:07:44.731 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:07:44.750+0000 7f84bcc83780 -1 osd.2 0 log_to_monitors true 2026-02-21T12:07:44.749 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:07:45.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:07:45.751 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:07:45.751 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:07:45.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:07:45.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:07:45.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:07:45.982 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1340341978,v1:127.0.0.1:6819/1340341978] [v2:127.0.0.1:6820/1340341978,v1:127.0.0.1:6821/1340341978] exists,up f3f7a802-ba4e-4713-b046-17267dbaaf6f 2026-02-21T12:07:45.983 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:07:45.983 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:07:45.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:07:45.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:437: TEST_divergent_2: ceph osd set noout 2026-02-21T12:07:46.250 INFO:tasks.workunit.client.0.trial058.stderr:noout is set 2026-02-21T12:07:46.257 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:438: TEST_divergent_2: ceph osd set noin 2026-02-21T12:07:46.555 INFO:tasks.workunit.client.0.trial058.stderr:noin is set 2026-02-21T12:07:46.565 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:439: TEST_divergent_2: ceph osd set nodown 2026-02-21T12:07:46.858 INFO:tasks.workunit.client.0.trial058.stderr:nodown is set 2026-02-21T12:07:46.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:440: TEST_divergent_2: create_pool test 1 1 2026-02-21T12:07:46.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-21T12:07:47.126 INFO:tasks.workunit.client.0.trial058.stderr:pool 'test' already exists 2026-02-21T12:07:47.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-21T12:07:48.136 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:441: TEST_divergent_2: ceph osd pool set test size 3 2026-02-21T12:07:48.448 INFO:tasks.workunit.client.0.trial058.stderr:set pool 1 size to 3 2026-02-21T12:07:48.458 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:442: TEST_divergent_2: ceph osd pool set test min_size 2 2026-02-21T12:07:48.752 INFO:tasks.workunit.client.0.trial058.stderr:set pool 1 min_size to 2 2026-02-21T12:07:48.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:444: TEST_divergent_2: flush_pg_stats 2026-02-21T12:07:48.760 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:07:48.760 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:07:48.990 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:07:48.990 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:07:48.991 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:07:48.991 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:07:48.991 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:07:48.991 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:07:49.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836484 2026-02-21T12:07:49.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836484 2026-02-21T12:07:49.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836484' 2026-02-21T12:07:49.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:07:49.057 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:07:49.125 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=38654705668 2026-02-21T12:07:49.125 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 38654705668 2026-02-21T12:07:49.125 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836484 1-38654705668' 2026-02-21T12:07:49.125 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:07:49.125 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:07:49.192 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=60129542147 2026-02-21T12:07:49.192 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 60129542147 2026-02-21T12:07:49.192 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836484 1-38654705668 2-60129542147' 2026-02-21T12:07:49.192 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:07:49.192 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836484 2026-02-21T12:07:49.192 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:07:49.193 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:07:49.194 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836484 2026-02-21T12:07:49.194 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:07:49.195 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836484 2026-02-21T12:07:49.195 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-21T12:07:49.196 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836484 2026-02-21T12:07:49.196 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:07:49.424 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-21T12:07:49.424 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:07:50.424 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:07:50.425 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:07:50.654 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-21T12:07:50.654 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:07:51.655 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-21T12:07:51.656 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:07:51.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-21T12:07:51.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:07:51.887 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-38654705668 2026-02-21T12:07:51.888 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:07:51.888 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:07:51.889 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-38654705668 2026-02-21T12:07:51.889 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:07:51.890 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=38654705668 2026-02-21T12:07:51.890 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-21T12:07:51.890 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 38654705668 2026-02-21T12:07:51.890 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:07:52.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-21T12:07:52.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:07:52.116 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-60129542147 2026-02-21T12:07:52.116 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:07:52.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:07:52.118 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-60129542147 2026-02-21T12:07:52.118 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:07:52.119 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=60129542147 2026-02-21T12:07:52.119 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-21T12:07:52.119 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 60129542147 2026-02-21T12:07:52.119 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:07:52.349 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-21T12:07:52.349 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:445: TEST_divergent_2: wait_for_clean 2026-02-21T12:07:52.350 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:07:52.350 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:07:52.350 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:07:52.350 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-21T12:07:52.350 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:07:52.350 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:07:52.351 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:07:52.351 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:07:52.351 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:07:52.435 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-21T12:07:52.435 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:07:52.435 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:07:52.435 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:07:52.435 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:07:52.435 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:07:52.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:07:52.664 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:07:52.664 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:07:52.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:07:52.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:07:52.664 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:07:52.732 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836487 2026-02-21T12:07:52.733 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836487 2026-02-21T12:07:52.733 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836487' 2026-02-21T12:07:52.733 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:07:52.733 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:07:52.801 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=38654705670 2026-02-21T12:07:52.802 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 38654705670 2026-02-21T12:07:52.802 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-21T12:07:52.802 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:07:52.802 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:07:52.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=60129542150 2026-02-21T12:07:52.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 60129542150 2026-02-21T12:07:52.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-60129542150' 2026-02-21T12:07:52.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:07:52.869 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836487 2026-02-21T12:07:52.869 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:07:52.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:07:52.870 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836487 2026-02-21T12:07:52.871 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:07:52.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836487 2026-02-21T12:07:52.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-21T12:07:52.872 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836487 2026-02-21T12:07:52.872 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:07:53.100 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-21T12:07:53.100 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:07:53.100 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-38654705670 2026-02-21T12:07:53.100 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:07:53.101 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:07:53.102 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-38654705670 2026-02-21T12:07:53.102 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:07:53.103 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=38654705670 2026-02-21T12:07:53.103 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-21T12:07:53.103 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 38654705670 2026-02-21T12:07:53.103 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:07:53.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-21T12:07:53.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:07:53.331 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-60129542150 2026-02-21T12:07:53.331 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:07:53.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:07:53.333 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-60129542150 2026-02-21T12:07:53.333 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:07:53.334 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=60129542150 2026-02-21T12:07:53.335 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-21T12:07:53.335 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 60129542150 2026-02-21T12:07:53.335 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:07:53.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-21T12:07:53.561 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:07:53.561 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:07:53.561 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:07:53.877 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:07:53.878 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:07:53.878 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:07:53.878 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:07:53.878 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:07:53.878 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:07:53.878 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:07:53.878 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:07:54.101 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-21T12:07:54.102 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:07:54.102 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:07:54.102 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:07:54.419 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-21T12:07:54.419 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:07:54.420 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:07:54.420 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: ceph pg dump pgs --format=json 2026-02-21T12:07:54.420 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: jq '.pg_stats[0].up_primary' 2026-02-21T12:07:54.637 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:07:54.644 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: local divergent=1 2026-02-21T12:07:54.645 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:449: TEST_divergent_2: echo 'primary and soon to be divergent is 1' 2026-02-21T12:07:54.645 INFO:tasks.workunit.client.0.trial058.stdout:primary and soon to be divergent is 1 2026-02-21T12:07:54.645 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:450: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:07:54.862 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:07:54.862 INFO:tasks.workunit.client.0.trial058.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-21T12:07:47.749385+0000 0'0 27:26 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T23:17:53.594559+0000 0 0 2026-02-21T12:07:54.862 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:07:54.862 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:07:54.862 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:07:54.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: local non_divergent= 2026-02-21T12:07:54.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-21T12:07:54.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 0 = 1 ']' 2026-02-21T12:07:54.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0' 2026-02-21T12:07:54.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-21T12:07:54.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 1 = 1 ']' 2026-02-21T12:07:54.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:455: TEST_divergent_2: continue 2026-02-21T12:07:54.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-21T12:07:54.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 2 = 1 ']' 2026-02-21T12:07:54.871 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0 2' 2026-02-21T12:07:54.871 INFO:tasks.workunit.client.0.trial058.stdout:writing initial objects 2026-02-21T12:07:54.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:460: TEST_divergent_2: echo 'writing initial objects' 2026-02-21T12:07:54.872 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: seq 1 100 2026-02-21T12:07:54.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:54.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:54.891 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:54.891 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:54.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:54.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_3 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:54.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:54.929 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:54.948 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:54.948 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_5 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:54.966 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:54.966 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_6 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:54.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:54.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_7 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.003 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.003 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_8 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_9 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_10 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.058 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.059 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_11 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.077 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.077 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_12 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.096 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.096 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_13 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.115 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.115 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_14 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.133 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.133 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_15 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.152 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.152 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_16 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_17 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.189 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.189 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_18 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.208 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.208 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_19 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.227 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.227 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_20 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_21 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.265 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.265 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_22 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.283 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.283 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_23 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.302 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.303 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_24 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.321 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.321 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_25 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.339 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.340 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_26 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.358 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.358 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_27 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.377 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.377 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_28 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_29 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.413 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.414 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_30 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.432 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.432 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_31 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.451 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.452 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_32 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_33 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.489 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.490 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_34 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.508 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.508 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_35 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.527 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.527 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_36 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.547 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_37 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.566 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.566 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_38 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_39 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_40 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.623 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.624 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_41 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.642 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.643 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_42 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_43 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.679 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.680 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_44 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.699 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.699 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_45 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_46 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_47 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.757 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.757 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_48 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_49 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.795 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.795 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_50 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.814 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.814 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_51 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.833 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.833 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_52 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.852 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.852 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_53 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.871 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.871 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_54 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.888 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.888 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_55 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.907 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.907 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_56 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.926 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.926 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_57 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.944 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.945 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_58 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_59 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:55.982 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:55.982 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_60 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_61 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_62 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.038 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.038 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_63 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_64 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.075 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.075 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_65 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.093 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.093 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_66 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.112 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.112 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_67 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.131 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.131 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_68 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.150 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.151 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_69 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_70 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.188 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.189 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_71 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.209 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.209 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_72 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_73 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.247 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.247 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_74 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_75 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.284 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.285 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_76 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.302 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.303 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_77 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_78 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.340 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.341 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_79 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_80 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.378 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.378 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_81 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_82 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.416 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.416 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_83 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.434 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.434 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_84 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.452 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.452 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_85 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_86 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.490 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.490 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_87 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.508 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.508 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_88 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.527 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.527 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_89 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_90 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.564 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.565 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_91 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_92 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.602 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.603 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_93 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.622 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.622 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_94 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.641 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_95 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_96 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.679 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.679 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_97 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.698 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.698 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_98 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_99 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.735 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-21T12:07:56.735 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_100 /tmp/tmp.yvksX6h33X 2026-02-21T12:07:56.754 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-21T12:07:56.754 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: wait_for_clean 2026-02-21T12:07:56.754 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:07:56.755 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:07:56.755 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:07:56.755 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-21T12:07:56.756 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:07:56.756 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:07:56.756 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:07:56.756 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:07:56.756 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:07:56.807 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-21T12:07:56.807 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:07:56.807 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:07:56.807 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:07:56.807 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:07:56.807 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:07:57.039 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:07:57.040 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:07:57.040 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:07:57.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:07:57.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:07:57.040 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:07:57.111 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836490 2026-02-21T12:07:57.111 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836490 2026-02-21T12:07:57.111 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836490' 2026-02-21T12:07:57.111 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:07:57.111 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:07:57.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=38654705673 2026-02-21T12:07:57.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 38654705673 2026-02-21T12:07:57.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836490 1-38654705673' 2026-02-21T12:07:57.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:07:57.180 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:07:57.250 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=60129542153 2026-02-21T12:07:57.250 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 60129542153 2026-02-21T12:07:57.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836490 1-38654705673 2-60129542153' 2026-02-21T12:07:57.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:07:57.251 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836490 2026-02-21T12:07:57.251 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:07:57.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:07:57.252 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836490 2026-02-21T12:07:57.252 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:07:57.253 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836490 2026-02-21T12:07:57.253 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-21T12:07:57.253 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836490 2026-02-21T12:07:57.253 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:07:57.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-21T12:07:57.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:07:58.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:07:58.482 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:07:58.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-21T12:07:58.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:07:59.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-21T12:07:59.712 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:07:59.942 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-21T12:07:59.942 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:07:59.942 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-38654705673 2026-02-21T12:07:59.942 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:07:59.943 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:07:59.943 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-38654705673 2026-02-21T12:07:59.944 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:07:59.945 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=38654705673 2026-02-21T12:07:59.945 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-21T12:07:59.945 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 38654705673 2026-02-21T12:07:59.945 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:08:00.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 38654705674 -lt 38654705673 2026-02-21T12:08:00.173 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:08:00.173 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-60129542153 2026-02-21T12:08:00.173 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:08:00.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:08:00.175 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-60129542153 2026-02-21T12:08:00.175 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:08:00.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=60129542153 2026-02-21T12:08:00.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-21T12:08:00.177 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 60129542153 2026-02-21T12:08:00.177 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:08:00.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-21T12:08:00.408 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:08:00.408 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:00.408 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:00.725 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:08:00.725 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:00.726 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:00.726 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:00.726 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:00.726 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:00.726 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:00.726 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:00.946 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-21T12:08:00.947 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:00.947 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:00.948 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:01.263 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-21T12:08:01.263 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:08:01.264 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:08:01.264 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: get_pg test existing_1 2026-02-21T12:08:01.264 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-21T12:08:01.264 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-21T12:08:01.264 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-21T12:08:01.264 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-21T12:08:01.494 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: local pgid=1.0 2026-02-21T12:08:01.494 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:472: TEST_divergent_2: echo 'blackholing osds 0 2' 2026-02-21T12:08:01.494 INFO:tasks.workunit.client.0.trial058.stdout:blackholing osds 0 2 2026-02-21T12:08:01.495 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:08:01.709 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:08:01.709 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-21T12:07:47.749385+0000 27'100 27:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T23:17:53.594559+0000 0 0 2026-02-21T12:08:01.709 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:08:01.709 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:08:01.710 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:08:01.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-21T12:08:01.716 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.0 2026-02-21T12:08:01.716 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-21T12:08:01.716 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-21T12:08:01.716 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:08:01.717 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:08:01.717 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:08:01.717 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.0.asok 2026-02-21T12:08:01.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-21T12:08:01.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-21T12:08:01.759 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:08:01.759 INFO:tasks.workunit.client.0.trial058.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-21T12:08:01.760 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:08:01.763 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-21T12:08:01.763 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.2 2026-02-21T12:08:01.763 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-21T12:08:01.763 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-21T12:08:01.764 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:08:01.764 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:08:01.764 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:08:01.764 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.2.asok 2026-02-21T12:08:01.764 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-21T12:08:01.764 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-21T12:08:01.805 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:08:01.806 INFO:tasks.workunit.client.0.trial058.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-21T12:08:01.806 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:08:01.809 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: echo 'create new divergent objects' 2026-02-21T12:08:01.810 INFO:tasks.workunit.client.0.trial058.stdout:create new divergent objects 2026-02-21T12:08:01.811 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: seq 1 2 2026-02-21T12:08:01.811 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-21T12:08:01.811 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-21T12:08:01.811 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_1 2026-02-21T12:08:01.811 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: echo 'writing divergent objects' 2026-02-21T12:08:01.812 INFO:tasks.workunit.client.0.trial058.stdout:writing divergent objects 2026-02-21T12:08:01.813 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_2 2026-02-21T12:08:01.813 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: seq 1 2 2026-02-21T12:08:01.813 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-21T12:08:01.813 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-21T12:08:01.813 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.6S0Ai3Bxnd 2026-02-21T12:08:01.814 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: echo 'remove divergent objects' 2026-02-21T12:08:01.814 INFO:tasks.workunit.client.0.trial058.stdout:remove divergent objects 2026-02-21T12:08:01.815 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.6S0Ai3Bxnd 2026-02-21T12:08:01.816 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: seq 1 2 2026-02-21T12:08:01.816 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-21T12:08:01.816 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 1 + 2 2026-02-21T12:08:01.816 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=3 2026-02-21T12:08:01.816 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-21T12:08:01.816 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_3 2026-02-21T12:08:01.816 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 2 + 2 2026-02-21T12:08:01.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=4 2026-02-21T12:08:01.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:498: TEST_divergent_2: sleep 10 2026-02-21T12:08:01.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_4 2026-02-21T12:08:11.818 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:499: TEST_divergent_2: killall -9 rados 2026-02-21T12:08:11.840 INFO:tasks.workunit.client.0.trial058.stderr:rados: no process found 2026-02-21T12:08:11.841 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:502: TEST_divergent_2: echo 'killing all the osds' 2026-02-21T12:08:11.841 INFO:tasks.workunit.client.0.trial058.stdout:killing all the osds 2026-02-21T12:08:11.841 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:503: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:08:12.059 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:08:12.059 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-21T12:07:47.749385+0000 27'106 27:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T23:17:53.594559+0000 0 0 2026-02-21T12:08:12.059 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:08:12.059 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:08:12.060 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:08:12.066 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd 2026-02-21T12:08:12.067 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:08:12.067 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:08:12.067 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:08:12.067 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:08:12.067 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:08:12.173 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:08:12.173 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-21T12:08:12.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.0 2026-02-21T12:08:12.453 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already down. 2026-02-21T12:08:12.460 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-21T12:08:12.461 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.1 2026-02-21T12:08:12.741 INFO:tasks.workunit.client.0.trial058.stderr:osd.1 is already down. 2026-02-21T12:08:12.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-21T12:08:12.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.2 2026-02-21T12:08:13.028 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already down. 2026-02-21T12:08:13.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-21T12:08:13.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.0 2026-02-21T12:08:13.314 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already out. 2026-02-21T12:08:13.321 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-21T12:08:13.321 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.2 2026-02-21T12:08:13.603 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already out. 2026-02-21T12:08:13.610 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:515: TEST_divergent_2: echo 'bringing up non_divergent 0 2' 2026-02-21T12:08:13.610 INFO:tasks.workunit.client.0.trial058.stdout:bringing up non_divergent 0 2 2026-02-21T12:08:13.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:08:13.832 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:08:13.832 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-21T12:07:47.749385+0000 27'106 27:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T23:17:53.594559+0000 0 0 2026-02-21T12:08:13.833 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:08:13.833 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:08:13.833 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:08:13.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-21T12:08:13.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 0 2026-02-21T12:08:13.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:08:13.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:08:13.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-21T12:08:13.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:08:13.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-21T12:08:13.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:08:13.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:08:13.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:08:13.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:08:13.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-21T12:08:13.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-21T12:08:13.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:08:13.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:08:13.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:08:13.843 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:08:13.843 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:08:13.844 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:08:13.844 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:08:13.844 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:08:13.844 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:08:13.844 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:08:13.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:08:13.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:08:13.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:08:13.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:08:13.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:08:13.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:08:13.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:08:13.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:08:13.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:08:13.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:08:13.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-21T12:08:13.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-21T12:08:13.845 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:08:13.846 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:08:13.846 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-21T12:08:13.846 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-21T12:08:13.846 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:08:13.847 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:08:13.847 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:08:13.861 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:08:13.881+0000 7f4218e19780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:08:13.862 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:08:13.882+0000 7f4218e19780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:08:13.863 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:08:13.883+0000 7f4218e19780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:08:14.005 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:08:14.025+0000 7f4218e19780 -1 Falling back to public interface 2026-02-21T12:08:14.072 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-21T12:08:14.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:08:14.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:08:14.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:08:14.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:08:14.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:08:14.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:08:14.074 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:08:14.074 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:08:14.074 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:08:14.299 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:08:14.366 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:08:14.386+0000 7f4218e19780 -1 osd.0 27 log_to_monitors true 2026-02-21T12:08:15.300 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:08:15.300 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:08:15.300 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:08:15.301 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:08:15.301 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:08:15.301 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:08:15.530 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up out weight 0 up_from 34 up_thru 0 down_at 28 last_clean_interval [5,27) [v2:127.0.0.1:6800/216235970,v1:127.0.0.1:6801/216235970] [v2:127.0.0.1:6802/216235970,v1:127.0.0.1:6803/216235970] exists,up 47b65e0c-dfc5-44b3-8760-5fe46ccd281a 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 2 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:08:15.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:08:15.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:08:15.533 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:08:15.533 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:08:15.533 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-21T12:08:15.533 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:08:15.533 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-21T12:08:15.533 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:08:15.533 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-21T12:08:15.534 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-21T12:08:15.535 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:08:15.535 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:08:15.535 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:08:15.551 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:08:15.571+0000 7f904a3d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:08:15.552 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:08:15.573+0000 7f904a3d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:08:15.553 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:08:15.574+0000 7f904a3d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:08:15.686 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:08:15.707+0000 7f904a3d6780 -1 Falling back to public interface 2026-02-21T12:08:15.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-21T12:08:15.767 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:08:15.767 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:08:15.767 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:08:15.767 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:08:15.767 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:08:15.767 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:08:15.768 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:08:15.768 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:08:15.768 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:08:15.992 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:08:16.012+0000 7f904a3d6780 -1 osd.2 27 log_to_monitors true 2026-02-21T12:08:15.999 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:08:17.001 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:08:17.001 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:08:17.002 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:08:17.002 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:08:17.002 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:08:17.003 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:08:17.228 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up out weight 0 up_from 37 up_thru 0 down_at 30 last_clean_interval [14,27) [v2:127.0.0.1:6810/3353305722,v1:127.0.0.1:6811/3353305722] [v2:127.0.0.1:6812/3353305722,v1:127.0.0.1:6813/3353305722] exists,up f3f7a802-ba4e-4713-b046-17267dbaaf6f 2026-02-21T12:08:17.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:08:17.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:08:17.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:08:17.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-21T12:08:17.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.0 2026-02-21T12:08:17.469 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already in. 2026-02-21T12:08:17.477 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-21T12:08:17.478 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.2 2026-02-21T12:08:17.776 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already in. 2026-02-21T12:08:17.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-21T12:08:17.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: wait_for_clean 2026-02-21T12:08:17.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:08:17.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:08:17.785 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:08:17.785 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-21T12:08:17.785 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:08:17.786 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:08:17.786 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:08:17.786 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:08:17.786 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:08:17.837 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-21T12:08:17.837 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:08:17.837 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:08:17.837 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:08:17.837 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:08:17.837 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:08:18.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:08:18.064 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:08:18.064 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:08:18.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:08:18.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:08:18.064 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:08:18.132 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=146028888067 2026-02-21T12:08:18.132 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 146028888067 2026-02-21T12:08:18.132 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-146028888067' 2026-02-21T12:08:18.132 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:08:18.132 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:08:18.181 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq= 2026-02-21T12:08:18.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: true 2026-02-21T12:08:18.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z '' 2026-02-21T12:08:18.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2289: flush_pg_stats: continue 2026-02-21T12:08:18.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:08:18.182 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:08:18.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=158913789955 2026-02-21T12:08:18.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 158913789955 2026-02-21T12:08:18.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-146028888067 2-158913789955' 2026-02-21T12:08:18.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:08:18.252 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-146028888067 2026-02-21T12:08:18.252 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:08:18.253 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:08:18.253 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-146028888067 2026-02-21T12:08:18.253 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:08:18.254 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=146028888067 2026-02-21T12:08:18.254 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 146028888067 2026-02-21T12:08:18.255 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 146028888067' 2026-02-21T12:08:18.255 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:08:18.482 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 1 -lt 146028888067 2026-02-21T12:08:18.482 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:08:19.483 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:08:19.483 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:08:19.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 146028888067 -lt 146028888067 2026-02-21T12:08:19.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:08:19.716 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-158913789955 2026-02-21T12:08:19.716 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:08:19.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:08:19.718 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-158913789955 2026-02-21T12:08:19.718 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:08:19.719 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=158913789955 2026-02-21T12:08:19.719 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 158913789955 2026-02-21T12:08:19.720 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 158913789955' 2026-02-21T12:08:19.720 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:08:19.949 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 158913789955 -lt 158913789955 2026-02-21T12:08:19.949 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:08:19.950 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:19.950 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:20.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:08:20.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:20.266 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:20.267 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:20.267 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:20.267 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:20.267 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:20.267 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:20.495 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:20.495 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:20.495 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:20.495 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:20.813 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:20.813 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-21T12:08:20.813 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-21T12:08:20.813 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-21T12:08:20.813 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:20.813 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-21T12:08:20.915 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:20.915 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:20.915 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:20.915 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:20.915 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:20.916 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:20.916 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:20.916 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:21.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:21.141 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:21.141 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:21.141 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:21.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:21.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:21.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:21.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:21.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:21.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:21.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:21.458 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:21.458 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:21.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:21.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:21.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-21T12:08:21.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:21.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-21T12:08:21.972 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:21.973 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:21.974 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:21.974 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:21.974 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:21.974 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:21.974 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:21.974 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:22.198 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:22.198 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:22.199 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:22.199 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:22.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:22.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:22.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:22.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:22.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:22.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:22.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:22.516 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:22.517 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:22.830 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:22.831 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:22.831 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-21T12:08:22.831 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:22.831 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-21T12:08:23.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:23.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:23.230 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:23.231 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:23.231 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:23.231 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:23.231 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:23.231 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:23.456 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:23.456 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:23.457 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:23.457 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:23.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:23.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:23.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:23.774 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:23.774 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:23.774 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:23.774 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:23.774 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:23.774 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:24.089 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:24.089 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:24.089 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-21T12:08:24.089 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:24.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-21T12:08:24.890 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:24.890 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:24.891 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:24.891 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:24.891 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:24.891 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:24.891 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:24.892 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:25.122 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:25.122 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:25.123 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:25.123 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:25.441 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:25.441 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:25.441 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:25.441 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:25.441 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:25.441 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:25.441 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:25.441 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:25.441 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:25.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:25.760 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:25.760 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-21T12:08:25.760 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:25.760 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-21T12:08:27.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:27.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:27.361 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:27.361 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:27.361 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:27.361 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:27.361 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:27.361 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:27.590 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:27.590 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:27.591 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:27.591 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:27.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:27.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:27.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:27.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:27.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:27.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:27.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:27.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:27.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:28.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:28.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:28.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-21T12:08:28.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:28.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-21T12:08:31.431 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:31.431 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:31.432 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:31.432 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:31.432 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:31.432 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:31.432 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:31.433 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:31.656 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:31.656 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:31.657 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:31.657 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:31.973 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:31.973 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:31.974 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:31.974 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:31.974 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:31.974 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:31.974 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:31.974 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:31.974 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:32.288 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:32.288 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:32.288 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-21T12:08:32.289 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:32.289 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-21T12:08:38.691 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:38.691 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:38.691 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:38.691 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:38.692 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:38.692 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:38.692 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:38.692 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:38.922 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:38.923 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:38.923 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:38.923 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:39.240 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:39.240 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:39.240 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:39.240 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:39.240 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:39.240 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:39.240 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:39.241 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:39.241 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:39.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:39.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:39.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-21T12:08:39.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:39.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-21T12:08:46.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:46.862 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:46.863 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:46.863 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:46.863 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:46.863 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:46.863 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:46.863 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:47.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:47.090 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:47.091 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:47.091 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:47.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:47.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:47.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:47.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:47.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:47.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:47.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:47.409 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:47.410 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:47.723 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:47.723 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:47.724 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-21T12:08:47.724 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-21T12:08:48.030 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:08:48.031 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_fingerprint": "f61d202c-bd08-4f48-ab67-bdb81f9733fa", 2026-02-21T12:08:48.031 INFO:tasks.workunit.client.0.trial058.stdout: "version": "20.3.0-5397-gf7273f30", 2026-02-21T12:08:48.031 INFO:tasks.workunit.client.0.trial058.stdout: "commit": "f7273f3049146bdd7fa7b4a400114872a50228e9", 2026-02-21T12:08:48.031 INFO:tasks.workunit.client.0.trial058.stdout: "timestamp": "2026-02-21T12:08:48.051286+0000", 2026-02-21T12:08:48.031 INFO:tasks.workunit.client.0.trial058.stdout: "tag": "", 2026-02-21T12:08:48.031 INFO:tasks.workunit.client.0.trial058.stdout: "health": { 2026-02-21T12:08:48.031 INFO:tasks.workunit.client.0.trial058.stdout: "status": "HEALTH_WARN", 2026-02-21T12:08:48.031 INFO:tasks.workunit.client.0.trial058.stdout: "checks": { 2026-02-21T12:08:48.032 INFO:tasks.workunit.client.0.trial058.stdout: "OSDMAP_FLAGS": { 2026-02-21T12:08:48.032 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:08:48.032 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:08:48.032 INFO:tasks.workunit.client.0.trial058.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-21T12:08:48.032 INFO:tasks.workunit.client.0.trial058.stdout: "count": 17 2026-02-21T12:08:48.032 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.032 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [], 2026-02-21T12:08:48.032 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:08:48.032 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.032 INFO:tasks.workunit.client.0.trial058.stdout: "OSD_DOWN": { 2026-02-21T12:08:48.032 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:08:48.032 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: "message": "1 osds down", 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: "count": 1 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: "message": "osd.1 (root=default,host=trial058) is down" 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: "PG_DEGRADED": { 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:08:48.033 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:08:48.034 INFO:tasks.workunit.client.0.trial058.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-21T12:08:48.034 INFO:tasks.workunit.client.0.trial058.stdout: "count": 1 2026-02-21T12:08:48.034 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.034 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:08:48.034 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.034 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:08:48.034 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.034 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.034 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:08:48.034 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.034 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.035 INFO:tasks.workunit.client.0.trial058.stdout: "mutes": [] 2026-02-21T12:08:48.035 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.035 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_first_committed": 1, 2026-02-21T12:08:48.035 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_last_committed": 1, 2026-02-21T12:08:48.035 INFO:tasks.workunit.client.0.trial058.stdout: "monmap": { 2026-02-21T12:08:48.035 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:08:48.035 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:08:48.035 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:07:38.675889Z", 2026-02-21T12:08:48.035 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:07:38.675889Z", 2026-02-21T12:08:48.035 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release": 20, 2026-02-21T12:08:48.035 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-21T12:08:48.035 INFO:tasks.workunit.client.0.trial058.stdout: "election_strategy": 1, 2026-02-21T12:08:48.036 INFO:tasks.workunit.client.0.trial058.stdout: "disallowed_leaders": "", 2026-02-21T12:08:48.036 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": false, 2026-02-21T12:08:48.036 INFO:tasks.workunit.client.0.trial058.stdout: "tiebreaker_mon": "", 2026-02-21T12:08:48.036 INFO:tasks.workunit.client.0.trial058.stdout: "removed_ranks": "", 2026-02-21T12:08:48.036 INFO:tasks.workunit.client.0.trial058.stdout: "features": { 2026-02-21T12:08:48.036 INFO:tasks.workunit.client.0.trial058.stdout: "persistent": [ 2026-02-21T12:08:48.036 INFO:tasks.workunit.client.0.trial058.stdout: "kraken", 2026-02-21T12:08:48.036 INFO:tasks.workunit.client.0.trial058.stdout: "luminous", 2026-02-21T12:08:48.036 INFO:tasks.workunit.client.0.trial058.stdout: "mimic", 2026-02-21T12:08:48.036 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap-prune", 2026-02-21T12:08:48.037 INFO:tasks.workunit.client.0.trial058.stdout: "nautilus", 2026-02-21T12:08:48.037 INFO:tasks.workunit.client.0.trial058.stdout: "octopus", 2026-02-21T12:08:48.037 INFO:tasks.workunit.client.0.trial058.stdout: "pacific", 2026-02-21T12:08:48.037 INFO:tasks.workunit.client.0.trial058.stdout: "elector-pinging", 2026-02-21T12:08:48.037 INFO:tasks.workunit.client.0.trial058.stdout: "quincy", 2026-02-21T12:08:48.037 INFO:tasks.workunit.client.0.trial058.stdout: "reef", 2026-02-21T12:08:48.037 INFO:tasks.workunit.client.0.trial058.stdout: "squid", 2026-02-21T12:08:48.037 INFO:tasks.workunit.client.0.trial058.stdout: "tentacle", 2026-02-21T12:08:48.037 INFO:tasks.workunit.client.0.trial058.stdout: "nvmeof_beacon_diff" 2026-02-21T12:08:48.037 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.038 INFO:tasks.workunit.client.0.trial058.stdout: "optional": [] 2026-02-21T12:08:48.038 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.038 INFO:tasks.workunit.client.0.trial058.stdout: "mons": [ 2026-02-21T12:08:48.038 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.038 INFO:tasks.workunit.client.0.trial058.stdout: "rank": 0, 2026-02-21T12:08:48.038 INFO:tasks.workunit.client.0.trial058.stdout: "name": "a", 2026-02-21T12:08:48.038 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:08:48.038 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.038 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.038 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.038 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115", 2026-02-21T12:08:48.038 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 0 2026-02-21T12:08:48.039 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.039 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.039 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.039 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115/0", 2026-02-21T12:08:48.039 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-21T12:08:48.039 INFO:tasks.workunit.client.0.trial058.stdout: "priority": 0, 2026-02-21T12:08:48.039 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 0, 2026-02-21T12:08:48.039 INFO:tasks.workunit.client.0.trial058.stdout: "time_added": "2026-02-21T12:07:38:675885+0000", 2026-02-21T12:08:48.039 INFO:tasks.workunit.client.0.trial058.stdout: "crush_location": [] 2026-02-21T12:08:48.039 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.039 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.039 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.040 INFO:tasks.workunit.client.0.trial058.stdout: "quorum": [ 2026-02-21T12:08:48.040 INFO:tasks.workunit.client.0.trial058.stdout: 0 2026-02-21T12:08:48.040 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.040 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap": { 2026-02-21T12:08:48.040 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 43, 2026-02-21T12:08:48.040 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:08:48.040 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:07:38.710808+0000", 2026-02-21T12:08:48.040 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:08:17.831033+0000", 2026-02-21T12:08:48.040 INFO:tasks.workunit.client.0.trial058.stdout: "last_up_change": "2026-02-21T12:08:16.171491+0000", 2026-02-21T12:08:48.040 INFO:tasks.workunit.client.0.trial058.stdout: "last_in_change": "2026-02-21T12:08:17.730496+0000", 2026-02-21T12:08:48.040 INFO:tasks.workunit.client.0.trial058.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-21T12:08:48.040 INFO:tasks.workunit.client.0.trial058.stdout: "flags_num": 5800384, 2026-02-21T12:08:48.041 INFO:tasks.workunit.client.0.trial058.stdout: "flags_set": [ 2026-02-21T12:08:48.041 INFO:tasks.workunit.client.0.trial058.stdout: "nodown", 2026-02-21T12:08:48.041 INFO:tasks.workunit.client.0.trial058.stdout: "noin", 2026-02-21T12:08:48.041 INFO:tasks.workunit.client.0.trial058.stdout: "noout", 2026-02-21T12:08:48.041 INFO:tasks.workunit.client.0.trial058.stdout: "pglog_hardlimit", 2026-02-21T12:08:48.041 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snapdirs", 2026-02-21T12:08:48.041 INFO:tasks.workunit.client.0.trial058.stdout: "recovery_deletes", 2026-02-21T12:08:48.041 INFO:tasks.workunit.client.0.trial058.stdout: "sortbitwise" 2026-02-21T12:08:48.041 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.041 INFO:tasks.workunit.client.0.trial058.stdout: "crush_version": 9, 2026-02-21T12:08:48.041 INFO:tasks.workunit.client.0.trial058.stdout: "full_ratio": 0.99000000953674316, 2026-02-21T12:08:48.041 INFO:tasks.workunit.client.0.trial058.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_snapshot": "", 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: "pool_max": 1, 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: "max_osd": 3, 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: "require_min_compat_client": "luminous", 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: "min_compat_client": "jewel", 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: "require_osd_release": "tentacle", 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: "allow_crimson": false, 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: "pools": [ 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: "pool_name": "test", 2026-02-21T12:08:48.042 INFO:tasks.workunit.client.0.trial058.stdout: "create_time": "2026-02-21T12:07:47.057387+0000", 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "flags": 1, 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "flags_names": "hashpspool", 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "type": 1, 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "size": 3, 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "min_size": 2, 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "crush_rule": 0, 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_count": 0, 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_target": 0, 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_barrier": 0, 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "is_stretch_pool": false, 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "object_hash": 2, 2026-02-21T12:08:48.043 INFO:tasks.workunit.client.0.trial058.stdout: "pg_autoscale_mode": "off", 2026-02-21T12:08:48.044 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num": 1, 2026-02-21T12:08:48.044 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num": 1, 2026-02-21T12:08:48.044 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num_target": 1, 2026-02-21T12:08:48.044 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_target": 1, 2026-02-21T12:08:48.044 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_pending": 1, 2026-02-21T12:08:48.044 INFO:tasks.workunit.client.0.trial058.stdout: "last_pg_merge_meta": { 2026-02-21T12:08:48.044 INFO:tasks.workunit.client.0.trial058.stdout: "source_pgid": "0.0", 2026-02-21T12:08:48.044 INFO:tasks.workunit.client.0.trial058.stdout: "ready_epoch": 0, 2026-02-21T12:08:48.044 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_started": 0, 2026-02-21T12:08:48.044 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": 0, 2026-02-21T12:08:48.044 INFO:tasks.workunit.client.0.trial058.stdout: "source_version": "0'0", 2026-02-21T12:08:48.044 INFO:tasks.workunit.client.0.trial058.stdout: "target_version": "0'0" 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: "last_change": "27", 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend": "0", 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_preluminous": "0", 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: "auid": 0, 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: "snap_mode": "selfmanaged", 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: "snap_seq": 0, 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: "snap_epoch": 0, 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: "pool_snaps": [], 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps": "[]", 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_bytes": 0, 2026-02-21T12:08:48.045 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_objects": 0, 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "tiers": [], 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "tier_of": -1, 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "read_tier": -1, 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "write_tier": -1, 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "cache_mode": "none", 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_bytes": 0, 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_objects": 0, 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_flush_age": 0, 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_evict_age": 0, 2026-02-21T12:08:48.046 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profile": "", 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_params": { 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: "type": "none" 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_period": 0, 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_count": 0, 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: "use_gmt_hitset": true, 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: "min_read_recency_for_promote": 0, 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: "min_write_recency_for_promote": 0, 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_grade_decay_rate": 0, 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_search_last_n": 0, 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: "grade_table": [], 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: "stripe_width": 0, 2026-02-21T12:08:48.047 INFO:tasks.workunit.client.0.trial058.stdout: "expected_num_objects": 0, 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "fast_read": false, 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "nonprimary_shards": "{}", 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "options": {}, 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "application_metadata": {}, 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "read_balance": { 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "score_type": "Fair distribution", 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "score_acting": 2.9900000095367432, 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "score_stable": 2.9900000095367432, 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "optimal_score": 0.67000001668930054, 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "raw_score_acting": 2, 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "raw_score_stable": 2, 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity_weighted": 1, 2026-02-21T12:08:48.048 INFO:tasks.workunit.client.0.trial058.stdout: "average_primary_affinity": 1, 2026-02-21T12:08:48.049 INFO:tasks.workunit.client.0.trial058.stdout: "average_primary_affinity_weighted": 1 2026-02-21T12:08:48.049 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.049 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.049 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.049 INFO:tasks.workunit.client.0.trial058.stdout: "osds": [ 2026-02-21T12:08:48.049 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.049 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:08:48.049 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "47b65e0c-dfc5-44b3-8760-5fe46ccd281a", 2026-02-21T12:08:48.049 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:08:48.049 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:08:48.049 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:08:48.049 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 5, 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 27, 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 34, 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 42, 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 28, 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6800", 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:08:48.050 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6801", 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6802", 2026-02-21T12:08:48.051 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:08:48.052 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.052 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.052 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:08:48.052 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6803", 2026-02-21T12:08:48.052 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:08:48.052 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.052 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.052 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.052 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:08:48.052 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.052 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.052 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6806", 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6807", 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.053 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6804", 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6805", 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6801/216235970", 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6803/216235970", 2026-02-21T12:08:48.054 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6807/216235970", 2026-02-21T12:08:48.055 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6805/216235970", 2026-02-21T12:08:48.055 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:08:48.055 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:08:48.055 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:08:48.055 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.055 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.055 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.055 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:08:48.055 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "9c72da50-1daa-4602-ae45-087799931454", 2026-02-21T12:08:48.055 INFO:tasks.workunit.client.0.trial058.stdout: "up": 0, 2026-02-21T12:08:48.055 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:08:48.055 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 0, 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 0, 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 9, 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 21, 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 29, 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:08:48.056 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.057 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.058 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.059 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/699118437", 2026-02-21T12:08:48.060 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/699118437", 2026-02-21T12:08:48.061 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/699118437", 2026-02-21T12:08:48.061 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/699118437", 2026-02-21T12:08:48.061 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:08:48.061 INFO:tasks.workunit.client.0.trial058.stdout: "exists" 2026-02-21T12:08:48.061 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.061 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.061 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.061 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:08:48.061 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "f3f7a802-ba4e-4713-b046-17267dbaaf6f", 2026-02-21T12:08:48.061 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:08:48.061 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:08:48.061 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 14, 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 27, 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 37, 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 0, 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 30, 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:08:48.062 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:08:48.063 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.064 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:08:48.065 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:08:48.065 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.065 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.065 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:08:48.065 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:08:48.065 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:08:48.065 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.065 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.065 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.065 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:08:48.065 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:08:48.065 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/3353305722", 2026-02-21T12:08:48.066 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/3353305722", 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3353305722", 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3353305722", 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: "osd_xinfo": [ 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:08:12.408813+0000", 2026-02-21T12:08:48.067 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:08:48.068 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:08:48.068 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:08:48.068 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:08:48.068 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:07:41.193619+0000", 2026-02-21T12:08:48.068 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:08:48.068 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.068 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.068 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:08:48.068 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:08:12.694698+0000", 2026-02-21T12:08:48.068 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:08:48.068 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:07:43.151945+0000", 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:08:12.983971+0000", 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:07:45.799450+0000", 2026-02-21T12:08:48.069 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap": [], 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_items": [], 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_primaries": [], 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: "pg_temp": [], 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: "primary_temp": [], 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: "blocklist": {}, 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: "range_blocklist": {}, 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profiles": { 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: "default": { 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: "k": "2", 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: "m": "2", 2026-02-21T12:08:48.070 INFO:tasks.workunit.client.0.trial058.stdout: "plugin": "isa", 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: "technique": "reed_sol_van" 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps_queue": [], 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: "new_removed_snaps": [], 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: "new_purged_snaps": [], 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: "crush_node_flags": {}, 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: "device_class_flags": {}, 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": { 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_enabled": false, 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_bucket_count": 0, 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: "degraded_stretch_mode": 0, 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: "recovering_stretch_mode": 0, 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_bucket": 0 2026-02-21T12:08:48.071 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "osd_metadata": [ 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6802/216235970,v1:127.0.0.1:6803/216235970]", 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:08:48.072 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:08:48.073 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:07:39.420250Z", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6800/216235970,v1:127.0.0.1:6801/216235970]", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/216235970,v1:127.0.0.1:6807/216235970]", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/216235970,v1:127.0.0.1:6805/216235970]", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:08:48.074 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/0", 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/699118437,v1:127.0.0.1:6813/699118437]", 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:08:48.075 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:08:48.076 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:07:41.328858Z", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/699118437,v1:127.0.0.1:6811/699118437]", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/699118437,v1:127.0.0.1:6817/699118437]", 2026-02-21T12:08:48.077 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/699118437,v1:127.0.0.1:6815/699118437]", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/1", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:08:48.078 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/3353305722,v1:127.0.0.1:6813/3353305722]", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:08:48.079 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:07:43.944022Z", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/3353305722,v1:127.0.0.1:6811/3353305722]", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:08:48.080 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3353305722,v1:127.0.0.1:6817/3353305722]", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3353305722,v1:127.0.0.1:6815/3353305722]", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/2", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_clean_epochs": { 2026-02-21T12:08:48.081 INFO:tasks.workunit.client.0.trial058.stdout: "min_last_epoch_clean": 0, 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": { 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: "per_pool": [] 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: "osd_epochs": [ 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 34 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 37 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_first_committed": 1, 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_last_committed": 43, 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: "crushmap": { 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: "devices": [ 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.082 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.0", 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.1", 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.2", 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: "types": [ 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 0, 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd" 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.083 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: "name": "host" 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 2, 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: "name": "chassis" 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 3, 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: "name": "rack" 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 4, 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: "name": "row" 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 5, 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pdu" 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.084 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 6, 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pod" 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 7, 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: "name": "room" 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 8, 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: "name": "datacenter" 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 9, 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: "name": "zone" 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 10, 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: "name": "region" 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:08:48.085 INFO:tasks.workunit.client.0.trial058.stdout: "name": "root" 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "buckets": [ 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "id": -1, 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default", 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.086 INFO:tasks.workunit.client.0.trial058.stdout: "id": -2, 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default~ssd", 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058", 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:08:48.087 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058~ssd", 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:08:48.088 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: "rules": [ 2026-02-21T12:08:48.089 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "rule_id": 0, 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "rule_name": "replicated_rule", 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "type": 1, 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "steps": [ 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "op": "take", 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "item": -1, 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "item_name": "default" 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "op": "choose_firstn", 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "num": 0, 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "type": "osd" 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "op": "emit" 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "tunables": { 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_tries": 0, 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_fallback_tries": 0, 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "choose_total_tries": 50, 2026-02-21T12:08:48.090 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_descend_once": 1, 2026-02-21T12:08:48.091 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_vary_r": 1, 2026-02-21T12:08:48.091 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_stable": 1, 2026-02-21T12:08:48.091 INFO:tasks.workunit.client.0.trial058.stdout: "msr_descents": 100, 2026-02-21T12:08:48.091 INFO:tasks.workunit.client.0.trial058.stdout: "msr_collision_tries": 100, 2026-02-21T12:08:48.091 INFO:tasks.workunit.client.0.trial058.stderr:report 2043494799 2026-02-21T12:08:48.091 INFO:tasks.workunit.client.0.trial058.stdout: "straw_calc_version": 1, 2026-02-21T12:08:48.091 INFO:tasks.workunit.client.0.trial058.stdout: "allowed_bucket_algs": 54, 2026-02-21T12:08:48.091 INFO:tasks.workunit.client.0.trial058.stdout: "profile": "jewel", 2026-02-21T12:08:48.091 INFO:tasks.workunit.client.0.trial058.stdout: "optimal_tunables": 1, 2026-02-21T12:08:48.091 INFO:tasks.workunit.client.0.trial058.stdout: "legacy_tunables": 0, 2026-02-21T12:08:48.091 INFO:tasks.workunit.client.0.trial058.stdout: "minimum_required_version": "jewel", 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables": 1, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables2": 1, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "has_v2_rules": 0, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables3": 1, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "has_v3_rules": 0, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "has_v4_buckets": 1, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables5": 1, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "has_v5_rules": 0, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "has_msr_rules": 0 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "choose_args": {} 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "fsmap": { 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "btime": "2026-02-21T12:07:38:710637+0000", 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "default_fscid": -1, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "compat": { 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "compat": {}, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "ro_compat": {}, 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "incompat": { 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "feature_1": "base v0.20", 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "feature_2": "client writeable ranges", 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "feature_3": "default file layouts on dirs", 2026-02-21T12:08:48.092 INFO:tasks.workunit.client.0.trial058.stdout: "feature_4": "dir inode in separate object", 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "feature_5": "mds uses versioned encoding", 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "feature_8": "no anchor table", 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "feature_9": "file layout v2", 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "feature_10": "snaprealm v2", 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "feature_11": "minor log segments", 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "feature_12": "quiesce subvolumes" 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "feature_flags": { 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "enable_multiple": true, 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "ever_enabled_multiple": true 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "standbys": [], 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "filesystems": [] 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_first_committed": 1, 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_last_committed": 1, 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "auth": { 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 5, 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "num_secrets": 3 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.093 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 1, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_active": 1, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_unknown": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_osd": 3, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "pool_sum": { 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 51200, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 100, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 300, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 100, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 100, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 100, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 100, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:08:48.094 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 0, 2026-02-21T12:08:48.095 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 0, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 16, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 16, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "up": 2, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 2, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 0 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum": { 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 3, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 83904, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2120, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 27, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 81700, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314488896, 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:08:48.096 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322036629504, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2170880, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 438179, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 28659, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 83660813 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 0, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:08:48.097 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum_by_class": { 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "ssd": { 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 3, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 83904, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2120, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 27, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 81700, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314488896, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322036629504, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2170880, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 438179, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 28659, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 83660813 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:08:48.098 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 0, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "pool_stats": [ 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": 1, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 1, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 51200, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 100, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 0, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 300, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 100, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:08:48.099 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 100, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 100, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 100, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:08:48.100 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 1220608, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 153552, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 16, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 16, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "up": 2, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 2, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 3 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "osd_stats": [ 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 146028888073 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 38654705676 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.101 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 158913789961 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_state": [ 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "state": "active+undersized+degraded", 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "num": 1 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "pool_pg_unavailable_map": [ 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": "1", 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "pgs": [] 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_osd": [ 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 1, 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 1, 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 1, 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.102 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 0, 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": [ 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": {} 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "servicemap": { 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 3, 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:08:44.935017+0000", 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "services": { 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "osd": { 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "daemons": { 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "summary": "", 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "0": { 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "start_epoch": 0, 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "start_stamp": "0.000000", 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "gid": 0, 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "metadata": {}, 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "task_status": {} 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "2": { 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "start_epoch": 0, 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "start_stamp": "0.000000", 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "gid": 0, 2026-02-21T12:08:48.103 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: "metadata": {}, 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: "task_status": {} 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_first_committed": 1, 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_last_committed": 35, 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: "logm_first_committed": 1, 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: "logm_last_committed": 212, 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: "paxos": { 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 301, 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: "last_pn": 0, 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: "accepted_pn": 0 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: expr 2 + 2 2026-02-21T12:08:48.104 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: objname=existing_4 2026-02-21T12:08:48.105 INFO:tasks.workunit.client.0.trial058.stdout:writing non-divergent object existing_4 2026-02-21T12:08:48.105 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:530: TEST_divergent_2: echo 'writing non-divergent object existing_4' 2026-02-21T12:08:48.105 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:531: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:08:48.255 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:08:48.255 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:08:33.630846+0000 27'100 43:144 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:38:17.002335+0000 0 0 2026-02-21T12:08:48.255 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:08:48.255 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:08:48.255 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:08:48.262 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:532: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.6S0Ai3Bxnd 2026-02-21T12:08:48.282 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: rm -f /tmp/tmp.6S0Ai3Bxnd 2026-02-21T12:08:48.283 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-21T12:08:48.283 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: wait_for_clean 2026-02-21T12:08:48.283 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:08:48.283 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:08:48.283 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:08:48.283 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-21T12:08:48.283 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:08:48.283 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:08:48.283 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:08:48.283 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:08:48.283 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:08:48.336 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-21T12:08:48.337 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:08:48.337 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:08:48.337 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:08:48.337 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:08:48.337 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:08:48.566 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:08:48.566 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:08:48.566 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:08:48.566 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:08:48.567 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:08:48.567 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:08:48.634 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=146028888075 2026-02-21T12:08:48.634 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 146028888075 2026-02-21T12:08:48.635 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-146028888075' 2026-02-21T12:08:48.635 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:08:48.635 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:08:48.683 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq= 2026-02-21T12:08:48.683 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: true 2026-02-21T12:08:48.684 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z '' 2026-02-21T12:08:48.684 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2289: flush_pg_stats: continue 2026-02-21T12:08:48.684 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:08:48.684 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:08:48.751 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=158913789963 2026-02-21T12:08:48.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 158913789963 2026-02-21T12:08:48.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-146028888075 2-158913789963' 2026-02-21T12:08:48.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:08:48.752 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-146028888075 2026-02-21T12:08:48.752 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:08:48.753 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:08:48.753 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-146028888075 2026-02-21T12:08:48.754 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:08:48.755 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=146028888075 2026-02-21T12:08:48.755 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 146028888075' 2026-02-21T12:08:48.755 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 146028888075 2026-02-21T12:08:48.755 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:08:48.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 146028888075 -lt 146028888075 2026-02-21T12:08:48.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:08:48.985 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-158913789963 2026-02-21T12:08:48.985 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:08:48.985 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:08:48.986 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-158913789963 2026-02-21T12:08:48.986 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:08:48.987 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=158913789963 2026-02-21T12:08:48.988 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 158913789963 2026-02-21T12:08:48.988 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 158913789963' 2026-02-21T12:08:48.988 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:08:49.213 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 158913789963 -lt 158913789963 2026-02-21T12:08:49.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:08:49.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:49.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:49.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:08:49.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:49.530 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:49.530 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:49.530 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:49.530 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:49.530 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:49.530 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:49.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:49.760 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:49.760 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:49.760 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:50.078 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:50.078 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-21T12:08:50.078 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-21T12:08:50.078 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-21T12:08:50.079 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:50.079 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-21T12:08:50.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:50.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:50.179 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:50.180 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:50.180 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:50.180 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:50.180 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:50.180 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:50.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:50.405 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:50.406 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:50.406 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:50.723 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:50.723 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:50.723 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:50.723 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:50.723 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:50.723 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:50.724 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:50.724 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:50.724 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:51.038 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:51.039 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:51.039 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-21T12:08:51.039 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:51.039 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-21T12:08:51.239 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:51.239 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:51.240 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:51.240 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:51.240 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:51.240 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:51.240 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:51.240 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:51.466 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:51.467 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:51.467 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:51.467 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:51.783 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:51.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:51.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:51.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:51.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:51.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:51.784 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:51.784 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:51.784 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:52.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:52.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:52.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-21T12:08:52.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:52.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-21T12:08:52.499 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:52.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:52.501 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:52.501 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:52.501 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:52.501 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:52.501 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:52.501 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:52.726 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:52.726 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:52.726 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:52.726 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:53.045 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:53.045 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:53.045 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:53.045 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:53.045 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:53.045 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:53.045 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:53.045 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:53.045 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:53.362 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:53.362 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:53.362 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-21T12:08:53.362 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:53.362 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-21T12:08:54.163 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:54.163 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:54.164 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:54.164 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:54.164 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:54.164 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:54.164 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:54.164 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:54.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:54.391 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:54.391 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:54.391 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:54.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:54.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:54.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:54.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:54.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:54.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:54.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:54.711 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:54.711 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:55.024 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:55.025 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:55.025 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-21T12:08:55.025 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:55.025 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-21T12:08:56.625 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:08:56.626 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:08:56.627 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:08:56.627 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:08:56.627 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:08:56.627 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:08:56.627 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:08:56.627 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:08:56.851 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:08:56.852 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:08:56.852 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:08:56.853 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:08:57.167 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:08:57.168 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:08:57.168 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:08:57.168 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:08:57.168 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:08:57.168 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:08:57.168 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:08:57.168 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:08:57.168 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:08:57.484 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:08:57.484 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:08:57.484 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-21T12:08:57.484 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:08:57.484 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-21T12:09:00.684 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:09:00.685 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:09:00.686 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:09:00.687 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:09:00.687 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:09:00.687 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:09:00.687 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:09:00.687 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:09:00.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:09:00.910 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:09:00.910 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:09:00.910 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:09:01.226 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:09:01.227 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:09:01.227 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:09:01.227 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:09:01.227 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:09:01.227 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:09:01.227 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:09:01.227 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:09:01.228 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:09:01.539 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:09:01.539 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:09:01.539 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-21T12:09:01.540 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:09:01.540 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-21T12:09:07.940 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:09:07.940 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:09:07.941 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:09:07.942 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:09:07.942 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:09:07.942 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:09:07.942 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:09:07.942 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:09:08.165 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:09:08.166 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:09:08.166 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:09:08.166 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:09:08.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:09:08.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:09:08.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:09:08.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:09:08.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:09:08.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:09:08.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:09:08.481 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:09:08.481 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:09:08.796 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:09:08.796 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:09:08.796 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-21T12:09:08.796 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:09:08.796 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-21T12:09:16.096 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:09:16.097 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:09:16.098 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:09:16.098 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:09:16.098 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:09:16.098 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:09:16.098 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:09:16.098 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:09:16.329 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:09:16.329 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:09:16.330 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:09:16.330 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:09:16.648 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:09:16.648 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:09:16.648 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:09:16.648 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:09:16.648 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:09:16.648 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:09:16.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:09:16.649 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:09:16.649 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:09:16.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:09:16.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:09:16.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-21T12:09:16.962 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-21T12:09:17.273 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:09:17.273 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_fingerprint": "f61d202c-bd08-4f48-ab67-bdb81f9733fa", 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "version": "20.3.0-5397-gf7273f30", 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "commit": "f7273f3049146bdd7fa7b4a400114872a50228e9", 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "timestamp": "2026-02-21T12:09:17.294255+0000", 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "tag": "", 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "health": { 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "status": "HEALTH_WARN", 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "checks": { 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "OSDMAP_FLAGS": { 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "count": 17 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [], 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.274 INFO:tasks.workunit.client.0.trial058.stdout: "OSD_DOWN": { 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: "message": "1 osds down", 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: "count": 1 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: "message": "osd.1 (root=default,host=trial058) is down" 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: "PG_DEGRADED": { 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-21T12:09:17.275 INFO:tasks.workunit.client.0.trial058.stdout: "count": 1 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: "mutes": [] 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_first_committed": 1, 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_last_committed": 1, 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: "monmap": { 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:07:38.675889Z", 2026-02-21T12:09:17.276 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:07:38.675889Z", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release": 20, 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "election_strategy": 1, 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "disallowed_leaders": "", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": false, 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "tiebreaker_mon": "", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "removed_ranks": "", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "features": { 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "persistent": [ 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "kraken", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "luminous", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "mimic", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap-prune", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "nautilus", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "octopus", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "pacific", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "elector-pinging", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "quincy", 2026-02-21T12:09:17.277 INFO:tasks.workunit.client.0.trial058.stdout: "reef", 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: "squid", 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: "tentacle", 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: "nvmeof_beacon_diff" 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: "optional": [] 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: "mons": [ 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: "rank": 0, 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: "name": "a", 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115", 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 0 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.278 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115/0", 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "priority": 0, 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 0, 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "time_added": "2026-02-21T12:07:38:675885+0000", 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "crush_location": [] 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "quorum": [ 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: 0 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap": { 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 43, 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:07:38.710808+0000", 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:08:17.831033+0000", 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "last_up_change": "2026-02-21T12:08:16.171491+0000", 2026-02-21T12:09:17.279 INFO:tasks.workunit.client.0.trial058.stdout: "last_in_change": "2026-02-21T12:08:17.730496+0000", 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "flags_num": 5800384, 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "flags_set": [ 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "nodown", 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "noin", 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "noout", 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "pglog_hardlimit", 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snapdirs", 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "recovery_deletes", 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "sortbitwise" 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "crush_version": 9, 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "full_ratio": 0.99000000953674316, 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_snapshot": "", 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "pool_max": 1, 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "max_osd": 3, 2026-02-21T12:09:17.280 INFO:tasks.workunit.client.0.trial058.stdout: "require_min_compat_client": "luminous", 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "min_compat_client": "jewel", 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "require_osd_release": "tentacle", 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "allow_crimson": false, 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "pools": [ 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "pool_name": "test", 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "create_time": "2026-02-21T12:07:47.057387+0000", 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "flags": 1, 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "flags_names": "hashpspool", 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "type": 1, 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "size": 3, 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "min_size": 2, 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "crush_rule": 0, 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_count": 0, 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_target": 0, 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_barrier": 0, 2026-02-21T12:09:17.281 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "is_stretch_pool": false, 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "object_hash": 2, 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "pg_autoscale_mode": "off", 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num": 1, 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num": 1, 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num_target": 1, 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_target": 1, 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_pending": 1, 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "last_pg_merge_meta": { 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "source_pgid": "0.0", 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "ready_epoch": 0, 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_started": 0, 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": 0, 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "source_version": "0'0", 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "target_version": "0'0" 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "last_change": "27", 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend": "0", 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-21T12:09:17.282 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_preluminous": "0", 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "auid": 0, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "snap_mode": "selfmanaged", 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "snap_seq": 0, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "snap_epoch": 0, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "pool_snaps": [], 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps": "[]", 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_bytes": 0, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_objects": 0, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "tiers": [], 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "tier_of": -1, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "read_tier": -1, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "write_tier": -1, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "cache_mode": "none", 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_bytes": 0, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_objects": 0, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-21T12:09:17.283 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_flush_age": 0, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_evict_age": 0, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profile": "", 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_params": { 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "type": "none" 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_period": 0, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_count": 0, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "use_gmt_hitset": true, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "min_read_recency_for_promote": 0, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "min_write_recency_for_promote": 0, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_grade_decay_rate": 0, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_search_last_n": 0, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "grade_table": [], 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "stripe_width": 0, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "expected_num_objects": 0, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "fast_read": false, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "nonprimary_shards": "{}", 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "options": {}, 2026-02-21T12:09:17.284 INFO:tasks.workunit.client.0.trial058.stdout: "application_metadata": {}, 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "read_balance": { 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "score_type": "Fair distribution", 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "score_acting": 2.9900000095367432, 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "score_stable": 2.9900000095367432, 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "optimal_score": 0.67000001668930054, 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "raw_score_acting": 2, 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "raw_score_stable": 2, 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity_weighted": 1, 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "average_primary_affinity": 1, 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "average_primary_affinity_weighted": 1 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "osds": [ 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "47b65e0c-dfc5-44b3-8760-5fe46ccd281a", 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:09:17.285 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 5, 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 27, 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 34, 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 42, 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 28, 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6800", 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.286 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6801", 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6802", 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6803", 2026-02-21T12:09:17.287 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6806", 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6807", 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:09:17.288 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6804", 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6805", 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 216235970 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6801/216235970", 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6803/216235970", 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6807/216235970", 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6805/216235970", 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:09:17.289 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "9c72da50-1daa-4602-ae45-087799931454", 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "up": 0, 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 0, 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 0, 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 9, 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 21, 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 29, 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.290 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.291 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.292 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 699118437 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/699118437", 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/699118437", 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/699118437", 2026-02-21T12:09:17.293 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/699118437", 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "exists" 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "f3f7a802-ba4e-4713-b046-17267dbaaf6f", 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 14, 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 27, 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 37, 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 0, 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 30, 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:09:17.294 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:09:17.295 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:09:17.296 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3353305722 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/3353305722", 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/3353305722", 2026-02-21T12:09:17.297 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3353305722", 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3353305722", 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "osd_xinfo": [ 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:08:12.408813+0000", 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:07:41.193619+0000", 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:09:17.298 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:08:12.694698+0000", 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:07:43.151945+0000", 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:08:12.983971+0000", 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:07:45.799450+0000", 2026-02-21T12:09:17.299 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap": [], 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_items": [], 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_primaries": [], 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "pg_temp": [], 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "primary_temp": [], 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "blocklist": {}, 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "range_blocklist": {}, 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profiles": { 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "default": { 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "k": "2", 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "m": "2", 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "plugin": "isa", 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "technique": "reed_sol_van" 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.300 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps_queue": [], 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "new_removed_snaps": [], 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "new_purged_snaps": [], 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "crush_node_flags": {}, 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "device_class_flags": {}, 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": { 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_enabled": false, 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_bucket_count": 0, 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "degraded_stretch_mode": 0, 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "recovering_stretch_mode": 0, 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_bucket": 0 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "osd_metadata": [ 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6802/216235970,v1:127.0.0.1:6803/216235970]", 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:09:17.301 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:09:17.302 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:07:39.420250Z", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6800/216235970,v1:127.0.0.1:6801/216235970]", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/216235970,v1:127.0.0.1:6807/216235970]", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/216235970,v1:127.0.0.1:6805/216235970]", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:09:17.303 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/0", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/699118437,v1:127.0.0.1:6813/699118437]", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:09:17.304 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:09:17.305 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:07:41.328858Z", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/699118437,v1:127.0.0.1:6811/699118437]", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/699118437,v1:127.0.0.1:6817/699118437]", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/699118437,v1:127.0.0.1:6815/699118437]", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:09:17.306 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/1", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/3353305722,v1:127.0.0.1:6813/3353305722]", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:09:17.307 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:09:17.308 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:07:43.944022Z", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/3353305722,v1:127.0.0.1:6811/3353305722]", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3353305722,v1:127.0.0.1:6817/3353305722]", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3353305722,v1:127.0.0.1:6815/3353305722]", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/2", 2026-02-21T12:09:17.309 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_clean_epochs": { 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "min_last_epoch_clean": 0, 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": { 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "per_pool": [] 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "osd_epochs": [ 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 34 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 37 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_first_committed": 1, 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_last_committed": 43, 2026-02-21T12:09:17.310 INFO:tasks.workunit.client.0.trial058.stdout: "crushmap": { 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "devices": [ 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.0", 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.1", 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.2", 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "types": [ 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 0, 2026-02-21T12:09:17.311 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd" 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: "name": "host" 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 2, 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: "name": "chassis" 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 3, 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: "name": "rack" 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 4, 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: "name": "row" 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 5, 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pdu" 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 6, 2026-02-21T12:09:17.312 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pod" 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 7, 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: "name": "room" 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 8, 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: "name": "datacenter" 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 9, 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: "name": "zone" 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 10, 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: "name": "region" 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: "name": "root" 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.313 INFO:tasks.workunit.client.0.trial058.stdout: "buckets": [ 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "id": -1, 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default", 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "id": -2, 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default~ssd", 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:09:17.314 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058", 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.315 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058~ssd", 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:09:17.316 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "rules": [ 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "rule_id": 0, 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "rule_name": "replicated_rule", 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "type": 1, 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "steps": [ 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "op": "take", 2026-02-21T12:09:17.317 INFO:tasks.workunit.client.0.trial058.stdout: "item": -1, 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "item_name": "default" 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "op": "choose_firstn", 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "num": 0, 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "type": "osd" 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "op": "emit" 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "tunables": { 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_tries": 0, 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_fallback_tries": 0, 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "choose_total_tries": 50, 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_descend_once": 1, 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_vary_r": 1, 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_stable": 1, 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "msr_descents": 100, 2026-02-21T12:09:17.318 INFO:tasks.workunit.client.0.trial058.stdout: "msr_collision_tries": 100, 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stderr:report 749719823 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "straw_calc_version": 1, 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "allowed_bucket_algs": 54, 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "profile": "jewel", 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "optimal_tunables": 1, 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "legacy_tunables": 0, 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "minimum_required_version": "jewel", 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables": 1, 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables2": 1, 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "has_v2_rules": 0, 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables3": 1, 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "has_v3_rules": 0, 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "has_v4_buckets": 1, 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables5": 1, 2026-02-21T12:09:17.319 INFO:tasks.workunit.client.0.trial058.stdout: "has_v5_rules": 0, 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "has_msr_rules": 0 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "choose_args": {} 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "fsmap": { 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "btime": "2026-02-21T12:07:38:710637+0000", 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "default_fscid": -1, 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "compat": { 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "compat": {}, 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "ro_compat": {}, 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "incompat": { 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "feature_1": "base v0.20", 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "feature_2": "client writeable ranges", 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "feature_3": "default file layouts on dirs", 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "feature_4": "dir inode in separate object", 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "feature_5": "mds uses versioned encoding", 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "feature_8": "no anchor table", 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "feature_9": "file layout v2", 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "feature_10": "snaprealm v2", 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "feature_11": "minor log segments", 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: "feature_12": "quiesce subvolumes" 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.320 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "feature_flags": { 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "enable_multiple": true, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "ever_enabled_multiple": true 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "standbys": [], 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "filesystems": [] 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_first_committed": 1, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_last_committed": 1, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "auth": { 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 5, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "num_secrets": 3 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 1, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_active": 1, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_unknown": 0, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "num_osd": 3, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "pool_sum": { 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 51688, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 100, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 0, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 300, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:09:17.321 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 100, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 100, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 101, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 101, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:09:17.322 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 17, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 17, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "up": 2, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 2, 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 0 2026-02-21T12:09:17.323 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum": { 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 3, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 83904, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2120, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 27, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 81700, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314488896, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322036629504, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2170880, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 439155, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 28659, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 83660813 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:09:17.324 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 0, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum_by_class": { 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "ssd": { 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 3, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 83904, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2120, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 27, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 81700, 2026-02-21T12:09:17.325 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314488896, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322036629504, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2170880, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 439155, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 28659, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 83660813 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 0, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:09:17.326 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "pool_stats": [ 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": 1, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 1, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 51688, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 100, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 300, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 100, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 100, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 101, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 101, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:09:17.327 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 1220608, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 154528, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:09:17.328 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 17, 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 17, 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "up": 2, 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 2, 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 3 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "osd_stats": [ 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 146028888081 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 38654705676 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 158913789969 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_state": [ 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "state": "active+undersized+degraded", 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "num": 1 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "pool_pg_unavailable_map": [ 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": "1", 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: "pgs": [] 2026-02-21T12:09:17.329 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_osd": [ 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 1, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 1, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 1, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 0, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": [ 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": {} 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "servicemap": { 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 5, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:09:16.938557+0000", 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "services": {} 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:09:17.330 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_first_committed": 1, 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_last_committed": 50, 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stdout: "logm_first_committed": 1, 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stdout: "logm_last_committed": 273, 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stdout: "paxos": { 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 377, 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stdout: "last_pn": 0, 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stdout: "accepted_pn": 0 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: echo 'delay recovery' 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stdout:delay recovery 2026-02-21T12:09:17.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:539: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:09:17.500 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:09:17.500 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:08:33.630846+0000 43'101 43:145 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:38:17.002335+0000 0 0 2026-02-21T12:09:17.500 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:09:17.501 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:09:17.501 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:09:17.507 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-21T12:09:17.508 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.0 2026-02-21T12:09:17.508 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-21T12:09:17.508 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-21T12:09:17.508 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:09:17.508 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:17.508 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:17.508 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.0.asok 2026-02-21T12:09:17.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-21T12:09:17.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.0.asok set_recovery_delay 100000 2026-02-21T12:09:17.554 INFO:tasks.workunit.client.0.trial058.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-21T12:09:17.558 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-21T12:09:17.559 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.2 2026-02-21T12:09:17.559 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-21T12:09:17.559 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-21T12:09:17.559 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:09:17.559 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:17.560 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:17.560 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.2.asok 2026-02-21T12:09:17.560 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-21T12:09:17.560 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.2.asok set_recovery_delay 100000 2026-02-21T12:09:17.604 INFO:tasks.workunit.client.0.trial058.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-21T12:09:17.607 INFO:tasks.workunit.client.0.trial058.stdout:revive divergent 1 2026-02-21T12:09:17.608 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:546: TEST_divergent_2: echo 'revive divergent 1' 2026-02-21T12:09:17.608 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:547: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:09:17.825 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:09:17.825 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:08:33.630846+0000 43'101 43:145 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:38:17.002335+0000 0 0 2026-02-21T12:09:17.826 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:09:17.826 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:09:17.826 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:09:17.832 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:548: TEST_divergent_2: ceph osd set noup 2026-02-21T12:09:18.157 INFO:tasks.workunit.client.0.trial058.stderr:noup is set 2026-02-21T12:09:18.169 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:549: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-21T12:09:18.169 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:09:18.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:09:18.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-21T12:09:18.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:09:18.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-21T12:09:18.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:09:18.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:09:18.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:09:18.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:09:18.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-21T12:09:18.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-21T12:09:18.170 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:09:18.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:09:18.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:09:18.171 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:09:18.171 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:09:18.171 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:09:18.171 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:09:18.171 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:18.171 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:18.171 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:09:18.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:09:18.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:09:18.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:09:18.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:09:18.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:09:18.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:09:18.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:09:18.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:09:18.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:09:18.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:09:18.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-21T12:09:18.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-21T12:09:18.173 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:09:18.173 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:09:18.174 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-21T12:09:18.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-21T12:09:18.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:09:18.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:09:18.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:09:18.188 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:18.209+0000 7f225cb3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:18.189 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:18.210+0000 7f225cb3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:18.190 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:18.211+0000 7f225cb3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:18.334 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:18.355+0000 7f225cb3d780 -1 Falling back to public interface 2026-02-21T12:09:18.403 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-21T12:09:18.403 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:550: TEST_divergent_2: sleep 5 2026-02-21T12:09:18.635 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:18.656+0000 7f225cb3d780 -1 osd.1 27 log_to_monitors true 2026-02-21T12:09:23.404 INFO:tasks.workunit.client.0.trial058.stdout:delay recovery divergent 2026-02-21T12:09:23.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: echo 'delay recovery divergent' 2026-02-21T12:09:23.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:553: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:09:23.621 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:09:23.621 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:08:33.630846+0000 43'101 46:151 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:38:17.002335+0000 0 0 2026-02-21T12:09:23.621 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:09:23.621 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:09:23.621 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:09:23.628 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: get_asok_path osd.1 2026-02-21T12:09:23.629 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-21T12:09:23.629 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-21T12:09:23.629 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:09:23.629 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:23.629 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:23.629 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.1.asok 2026-02-21T12:09:23.630 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: CEPH_ARGS= 2026-02-21T12:09:23.630 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.1.asok set_recovery_delay 100000 2026-02-21T12:09:23.674 INFO:tasks.workunit.client.0.trial058.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-21T12:09:23.677 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:556: TEST_divergent_2: ceph osd unset noup 2026-02-21T12:09:23.989 INFO:tasks.workunit.client.0.trial058.stderr:noup is unset 2026-02-21T12:09:24.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:558: TEST_divergent_2: wait_for_osd up 0 2026-02-21T12:09:24.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:09:24.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:09:24.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:09:24.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:09:24.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:09:24.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:09:24.001 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:09:24.001 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:09:24.001 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:09:24.230 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 34 up_thru 42 down_at 28 last_clean_interval [5,27) [v2:127.0.0.1:6800/216235970,v1:127.0.0.1:6801/216235970] [v2:127.0.0.1:6802/216235970,v1:127.0.0.1:6803/216235970] exists,up 47b65e0c-dfc5-44b3-8760-5fe46ccd281a 2026-02-21T12:09:24.231 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:09:24.231 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:09:24.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:09:24.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:559: TEST_divergent_2: wait_for_osd up 1 2026-02-21T12:09:24.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:09:24.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:09:24.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:09:24.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:09:24.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:09:24.232 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:09:24.233 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:09:24.233 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:09:24.233 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:09:24.459 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 48 up_thru 48 down_at 29 last_clean_interval [9,27) [v2:127.0.0.1:6818/3651583409,v1:127.0.0.1:6819/3651583409] [v2:127.0.0.1:6820/3651583409,v1:127.0.0.1:6821/3651583409] exists,up 9c72da50-1daa-4602-ae45-087799931454 2026-02-21T12:09:24.460 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:09:24.461 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:09:24.461 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:09:24.461 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:560: TEST_divergent_2: wait_for_osd up 2 2026-02-21T12:09:24.461 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:09:24.461 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:09:24.461 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:09:24.461 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:09:24.461 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:09:24.462 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:09:24.462 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:09:24.462 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:09:24.463 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:09:24.692 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 37 up_thru 0 down_at 30 last_clean_interval [14,27) [v2:127.0.0.1:6810/3353305722,v1:127.0.0.1:6811/3353305722] [v2:127.0.0.1:6812/3353305722,v1:127.0.0.1:6813/3353305722] exists,up f3f7a802-ba4e-4713-b046-17267dbaaf6f 2026-02-21T12:09:24.693 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:09:24.693 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:09:24.693 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:09:24.693 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:562: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:09:24.908 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:09:24.909 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:08:33.630846+0000 43'101 46:151 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:38:17.002335+0000 0 0 2026-02-21T12:09:24.909 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:09:24.909 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:09:24.909 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:09:24.915 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:563: TEST_divergent_2: echo 'wait for peering' 2026-02-21T12:09:24.916 INFO:tasks.workunit.client.0.trial058.stdout:wait for peering 2026-02-21T12:09:24.916 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:564: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:09:25.133 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:09:25.133 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:08:33.630846+0000 43'101 47:153 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:38:17.002335+0000 0 0 2026-02-21T12:09:25.133 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:09:25.133 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:09:25.134 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:09:25.140 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:565: TEST_divergent_2: rados -p test put foo /tmp/tmp.yvksX6h33X 2026-02-21T12:09:25.160 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:566: TEST_divergent_2: rm -f /tmp/tmp.yvksX6h33X 2026-02-21T12:09:25.161 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:570: TEST_divergent_2: echo 'killing divergent 1' 2026-02-21T12:09:25.161 INFO:tasks.workunit.client.0.trial058.stdout:killing divergent 1 2026-02-21T12:09:25.161 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:571: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:09:25.378 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:09:25.379 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:08:33.630846+0000 43'101 47:153 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:38:17.002335+0000 0 0 2026-02-21T12:09:25.379 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:09:25.379 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:09:25.379 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:09:25.385 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:572: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd.1 2026-02-21T12:09:25.386 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:09:25.386 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:09:25.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:09:25.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:09:25.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:09:25.492 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:09:25.492 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:575: TEST_divergent_2: expfile=td/divergent-priors/exp.43953.out 2026-02-21T12:09:25.493 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:576: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.43953.out 2026-02-21T12:09:25.493 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-21T12:09:25.493 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-21T12:09:25.493 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-21T12:09:25.493 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-21T12:09:25.493 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-21T12:09:25.493 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.43953.out 2026-02-21T12:09:25.609 INFO:tasks.workunit.client.0.trial058.stderr:Exporting 1.0 info 1.0( v 49'102 lc 0'0 (27'90,49'102] local-lis/les=48/49 n=101 ec=21/21 lis/c=48/21 les/c/f=49/22/0 sis=48) 2026-02-21T12:09:25.610 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-21T12:09:25.610 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-21T12:09:25.610 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-21T12:09:25.610 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:091f9f1d:::existing_94:head# 2026-02-21T12:09:25.610 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:0a865a93:::existing_54:head# 2026-02-21T12:09:25.610 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:0fed513c:::existing_41:head# 2026-02-21T12:09:25.610 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:13b9e0b8:::existing_92:head# 2026-02-21T12:09:25.610 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:169157fa:::existing_81:head# 2026-02-21T12:09:25.610 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:17731382:::existing_58:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:18a45a39:::existing_43:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:1c160f01:::existing_66:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:1dd6c249:::existing_97:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:227e0c77:::existing_7:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:23e1b063:::existing_59:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:28566edb:::existing_78:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:2a101182:::existing_20:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:2d1519da:::existing_96:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:3078b87a:::existing_86:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:30bde01b:::existing_15:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:317a7e19:::existing_56:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:38b9c7fa:::existing_33:head# 2026-02-21T12:09:25.611 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:3e16d84b:::existing_48:head# 2026-02-21T12:09:25.612 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:45fe8203:::existing_75:head# 2026-02-21T12:09:25.612 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:4e82c9ba:::existing_50:head# 2026-02-21T12:09:25.612 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:5298dcdb:::existing_57:head# 2026-02-21T12:09:25.612 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:52ebaa44:::existing_32:head# 2026-02-21T12:09:25.612 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:53588912:::existing_9:head# 2026-02-21T12:09:25.612 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:5b7e2de6:::existing_84:head# 2026-02-21T12:09:25.612 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:5da0255c:::existing_13:head# 2026-02-21T12:09:25.612 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:5da2dab8:::existing_53:head# 2026-02-21T12:09:25.612 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:5ee3514b:::existing_30:head# 2026-02-21T12:09:25.612 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:602f83fe:::foo:head# 2026-02-21T12:09:25.612 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:60426cc7:::existing_62:head# 2026-02-21T12:09:25.612 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:628918ca:::existing_79:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:63f8ab2d:::existing_77:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:67e1780f:::existing_27:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:68143ca1:::existing_71:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:6bac9509:::existing_29:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:6bbec798:::existing_45:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:6cb23a40:::existing_65:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:7055ec5e:::existing_83:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:70a54e2b:::existing_87:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:750ace21:::existing_19:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:78623b1d:::existing_6:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:79881152:::existing_63:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:7a80c0d5:::existing_99:head# 2026-02-21T12:09:25.613 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:81490677:::existing_76:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:85ec8e5d:::existing_85:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:8e2abbf0:::existing_49:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:8ee0fe0f:::existing_52:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:923c5d4d:::existing_5:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:92731e71:::existing_89:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:928205cf:::existing_82:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:93be2267:::existing_24:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:99ceda2c:::existing_44:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:9dd917ee:::existing_26:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:a28805a6:::existing_72:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:a294a8f6:::existing_16:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:a2f5473a:::existing_42:head# 2026-02-21T12:09:25.614 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:a504a533:::existing_90:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:a691337e:::existing_61:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:a6e8d7ac:::existing_28:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:a9fde86e:::existing_18:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:aa309faa:::existing_68:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:ae40b0ed:::existing_31:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:b279b1fe:::existing_10:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:b343e277:::existing_88:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:b7130e90:::existing_80:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:bc6f7309:::existing_70:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:be8489b7:::existing_38:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:beb4e5e3:::existing_47:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:bebec877:::existing_74:head# 2026-02-21T12:09:25.615 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:c04347d8:::existing_60:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:c156033e:::existing_100:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:c19f5a8e:::existing_8:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:c3e6ebe4:::existing_17:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:c6c5a7c2:::existing_39:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:cc1d0abf:::existing_95:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:ccb3865b:::existing_73:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:cd84e19e:::existing_40:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:d2cd64ce:::existing_37:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:d41a25c9:::existing_22:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:d7f088da:::existing_91:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:d9cbd1d6:::existing_64:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:dcc4ff82:::existing_98:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:dd677bd3:::existing_35:head# 2026-02-21T12:09:25.616 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:dd6d90e7:::existing_46:head# 2026-02-21T12:09:25.617 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:e0e22077:::existing_21:head# 2026-02-21T12:09:25.617 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:e255b710:::existing_55:head# 2026-02-21T12:09:25.617 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:eff1d5db:::existing_14:head# 2026-02-21T12:09:25.617 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:f1b156bf:::existing_23:head# 2026-02-21T12:09:25.617 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:f5ce4199:::existing_34:head# 2026-02-21T12:09:25.617 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:f6809456:::existing_11:head# 2026-02-21T12:09:25.617 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:f699a2a9:::existing_67:head# 2026-02-21T12:09:25.617 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:f9baac43:::existing_25:head# 2026-02-21T12:09:25.617 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:fb76688e:::existing_51:head# 2026-02-21T12:09:25.617 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:fbb92eec:::existing_69:head# 2026-02-21T12:09:25.617 INFO:tasks.workunit.client.0.trial058.stderr:Export successful 2026-02-21T12:09:25.618 INFO:tasks.workunit.client.0.trial058.stdout: marking collection for removal 2026-02-21T12:09:25.618 INFO:tasks.workunit.client.0.trial058.stdout:setting '_remove' omap key 2026-02-21T12:09:25.618 INFO:tasks.workunit.client.0.trial058.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-21T12:09:25.619 INFO:tasks.workunit.client.0.trial058.stderr:Remove successful 2026-02-21T12:09:25.636 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:577: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.43953.out 2026-02-21T12:09:25.636 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-21T12:09:25.636 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-21T12:09:25.636 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-21T12:09:25.636 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-21T12:09:25.636 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-21T12:09:25.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.43953.out 2026-02-21T12:09:25.745 INFO:tasks.workunit.client.0.trial058.stdout:get_pg_num_history pg_num_history pg_num_history(e49 pg_nums {1={21=1}} deleted_pools ) 2026-02-21T12:09:25.745 INFO:tasks.workunit.client.0.trial058.stdout:Importing pgid 1.0 2026-02-21T12:09:25.746 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-21T12:09:25.746 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.746 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-21T12:09:25.746 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.746 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-21T12:09:25.746 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.746 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:091f9f1d:::existing_94:head# 2026-02-21T12:09:25.746 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.746 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:0a865a93:::existing_54:head# 2026-02-21T12:09:25.746 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.746 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:0fed513c:::existing_41:head# 2026-02-21T12:09:25.747 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.747 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:13b9e0b8:::existing_92:head# 2026-02-21T12:09:25.747 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.747 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:169157fa:::existing_81:head# 2026-02-21T12:09:25.747 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.747 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:17731382:::existing_58:head# 2026-02-21T12:09:25.747 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.747 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:18a45a39:::existing_43:head# 2026-02-21T12:09:25.747 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.747 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:1c160f01:::existing_66:head# 2026-02-21T12:09:25.747 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.747 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:1dd6c249:::existing_97:head# 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:227e0c77:::existing_7:head# 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:23e1b063:::existing_59:head# 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:28566edb:::existing_78:head# 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:2a101182:::existing_20:head# 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:2d1519da:::existing_96:head# 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:3078b87a:::existing_86:head# 2026-02-21T12:09:25.748 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.749 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:30bde01b:::existing_15:head# 2026-02-21T12:09:25.749 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.749 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:317a7e19:::existing_56:head# 2026-02-21T12:09:25.749 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.749 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:38b9c7fa:::existing_33:head# 2026-02-21T12:09:25.749 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.749 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:3e16d84b:::existing_48:head# 2026-02-21T12:09:25.749 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.749 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:45fe8203:::existing_75:head# 2026-02-21T12:09:25.749 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.749 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:4e82c9ba:::existing_50:head# 2026-02-21T12:09:25.749 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:5298dcdb:::existing_57:head# 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:52ebaa44:::existing_32:head# 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:53588912:::existing_9:head# 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:5b7e2de6:::existing_84:head# 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:5da0255c:::existing_13:head# 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:5da2dab8:::existing_53:head# 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.750 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:5ee3514b:::existing_30:head# 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:602f83fe:::foo:head# 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:60426cc7:::existing_62:head# 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:628918ca:::existing_79:head# 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:63f8ab2d:::existing_77:head# 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:67e1780f:::existing_27:head# 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:68143ca1:::existing_71:head# 2026-02-21T12:09:25.751 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:6bac9509:::existing_29:head# 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:6bbec798:::existing_45:head# 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:6cb23a40:::existing_65:head# 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:7055ec5e:::existing_83:head# 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:70a54e2b:::existing_87:head# 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:750ace21:::existing_19:head# 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:78623b1d:::existing_6:head# 2026-02-21T12:09:25.752 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:79881152:::existing_63:head# 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:7a80c0d5:::existing_99:head# 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:81490677:::existing_76:head# 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:85ec8e5d:::existing_85:head# 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:8e2abbf0:::existing_49:head# 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:8ee0fe0f:::existing_52:head# 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.753 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:923c5d4d:::existing_5:head# 2026-02-21T12:09:25.754 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.754 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:92731e71:::existing_89:head# 2026-02-21T12:09:25.754 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.754 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:928205cf:::existing_82:head# 2026-02-21T12:09:25.754 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.754 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:93be2267:::existing_24:head# 2026-02-21T12:09:25.754 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.754 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:99ceda2c:::existing_44:head# 2026-02-21T12:09:25.754 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.754 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:9dd917ee:::existing_26:head# 2026-02-21T12:09:25.754 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.754 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:a28805a6:::existing_72:head# 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:a294a8f6:::existing_16:head# 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:a2f5473a:::existing_42:head# 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:a504a533:::existing_90:head# 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:a691337e:::existing_61:head# 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:a6e8d7ac:::existing_28:head# 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:a9fde86e:::existing_18:head# 2026-02-21T12:09:25.755 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:aa309faa:::existing_68:head# 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:ae40b0ed:::existing_31:head# 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:b279b1fe:::existing_10:head# 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:b343e277:::existing_88:head# 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:b7130e90:::existing_80:head# 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:bc6f7309:::existing_70:head# 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.756 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:be8489b7:::existing_38:head# 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:beb4e5e3:::existing_47:head# 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:bebec877:::existing_74:head# 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:c04347d8:::existing_60:head# 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:c156033e:::existing_100:head# 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:c19f5a8e:::existing_8:head# 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:c3e6ebe4:::existing_17:head# 2026-02-21T12:09:25.757 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:c6c5a7c2:::existing_39:head# 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:cc1d0abf:::existing_95:head# 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:ccb3865b:::existing_73:head# 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:cd84e19e:::existing_40:head# 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:d2cd64ce:::existing_37:head# 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:d41a25c9:::existing_22:head# 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:d7f088da:::existing_91:head# 2026-02-21T12:09:25.758 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:d9cbd1d6:::existing_64:head# 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:dcc4ff82:::existing_98:head# 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:dd677bd3:::existing_35:head# 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:dd6d90e7:::existing_46:head# 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:e0e22077:::existing_21:head# 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:e255b710:::existing_55:head# 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.759 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:eff1d5db:::existing_14:head# 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:f1b156bf:::existing_23:head# 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:f5ce4199:::existing_34:head# 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:f6809456:::existing_11:head# 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:f699a2a9:::existing_67:head# 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:f9baac43:::existing_25:head# 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:fb76688e:::existing_51:head# 2026-02-21T12:09:25.760 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.761 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:fbb92eec:::existing_69:head# 2026-02-21T12:09:25.761 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:09:25.761 INFO:tasks.workunit.client.0.trial058.stdout:write_pg epoch 49 info 1.0( v 49'102 lc 0'0 (27'90,49'102] local-lis/les=48/49 n=101 ec=21/21 lis/c=48/21 les/c/f=49/22/0 sis=48) 2026-02-21T12:09:25.761 INFO:tasks.workunit.client.0.trial058.stdout:Import successful 2026-02-21T12:09:25.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:579: TEST_divergent_2: echo 'reviving divergent 1' 2026-02-21T12:09:25.779 INFO:tasks.workunit.client.0.trial058.stdout:reviving divergent 1 2026-02-21T12:09:25.779 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:580: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:09:26.001 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:09:26.001 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:08:33.630846+0000 43'101 47:153 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:38:17.002335+0000 0 0 2026-02-21T12:09:26.001 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:09:26.001 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:09:26.002 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:09:26.012 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:581: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-21T12:09:26.012 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:09:26.012 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:09:26.012 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-21T12:09:26.012 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:09:26.012 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-21T12:09:26.012 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:09:26.012 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:09:26.013 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:09:26.013 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:09:26.013 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-21T12:09:26.013 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-21T12:09:26.013 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:09:26.013 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:09:26.013 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:09:26.013 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:09:26.013 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:09:26.013 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:09:26.013 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:09:26.013 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:26.014 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:26.014 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:09:26.014 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:09:26.014 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:09:26.014 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:09:26.014 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:09:26.014 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:09:26.014 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:09:26.014 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:09:26.014 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:09:26.014 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:09:26.014 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:09:26.015 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-21T12:09:26.015 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-21T12:09:26.015 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:09:26.016 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:09:26.016 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-21T12:09:26.016 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-21T12:09:26.016 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:09:26.016 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:09:26.016 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:09:26.029 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:26.050+0000 7f13a640d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:26.031 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:26.051+0000 7f13a640d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:26.031 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:26.052+0000 7f13a640d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:26.152 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:26.173+0000 7f13a640d780 -1 Falling back to public interface 2026-02-21T12:09:26.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-21T12:09:26.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:09:26.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:09:26.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:09:26.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:09:26.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:09:26.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:09:26.245 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:09:26.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:09:26.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:09:26.458 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:26.478+0000 7f13a640d780 -1 osd.1 49 log_to_monitors true 2026-02-21T12:09:26.478 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 48 up_thru 48 down_at 29 last_clean_interval [9,27) [v2:127.0.0.1:6818/3651583409,v1:127.0.0.1:6819/3651583409] [v2:127.0.0.1:6820/3651583409,v1:127.0.0.1:6821/3651583409] exists,up 9c72da50-1daa-4602-ae45-087799931454 2026-02-21T12:09:26.479 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:09:26.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:09:26.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:09:26.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: wait_for_osd up 1 2026-02-21T12:09:26.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:09:26.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:09:26.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:09:26.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:09:26.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:09:26.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:09:26.481 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:09:26.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:09:26.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:09:26.708 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:09:27.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:09:27.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:09:27.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:09:27.710 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:09:27.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:09:27.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:09:27.938 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 52 up_thru 52 down_at 51 last_clean_interval [48,49) [v2:127.0.0.1:6818/3642981627,v1:127.0.0.1:6819/3642981627] [v2:127.0.0.1:6820/3642981627,v1:127.0.0.1:6821/3642981627] exists,up 9c72da50-1daa-4602-ae45-087799931454 2026-02-21T12:09:27.939 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:09:27.939 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:09:27.939 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:09:27.939 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:584: TEST_divergent_2: sleep 20 2026-02-21T12:09:47.941 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: get_asok_path osd.1 2026-02-21T12:09:47.942 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-21T12:09:47.942 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-21T12:09:47.942 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:09:47.942 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:47.942 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:47.942 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.1.asok 2026-02-21T12:09:47.943 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: CEPH_ARGS= 2026-02-21T12:09:47.943 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.1.asok dump_ops_in_flight 2026-02-21T12:09:47.986 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:09:47.986 INFO:tasks.workunit.client.0.trial058.stdout: "ops": [], 2026-02-21T12:09:47.987 INFO:tasks.workunit.client.0.trial058.stdout: "num_ops": 0 2026-02-21T12:09:47.987 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:09:47.990 INFO:tasks.workunit.client.0.trial058.stdout:allowing recovery 2026-02-21T12:09:47.990 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: echo 'allowing recovery' 2026-02-21T12:09:47.991 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:588: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:09:48.206 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:09:48.206 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-21T12:09:27.784979+0000 49'102 53:166 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:24:17.893448+0000 0 0 2026-02-21T12:09:48.206 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:09:48.206 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:09:48.207 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:09:48.212 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-21T12:09:48.212 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-21T12:09:48.273 INFO:tasks.workunit.client.0.trial058.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-21T12:09:48.278 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-21T12:09:48.278 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-21T12:09:48.338 INFO:tasks.workunit.client.0.trial058.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-21T12:09:48.343 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-21T12:09:48.343 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-21T12:09:48.404 INFO:tasks.workunit.client.0.trial058.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-21T12:09:48.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:595: TEST_divergent_2: echo 'reading divergent objects' 2026-02-21T12:09:48.409 INFO:tasks.workunit.client.0.trial058.stdout:reading divergent objects 2026-02-21T12:09:48.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: ceph pg dump pgs 2026-02-21T12:09:48.627 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:09:48.628 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-21T12:09:27.784979+0000 49'102 53:166 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:07:47.082125+0000 0'0 2026-02-21T12:07:47.082125+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:24:17.893448+0000 0 0 2026-02-21T12:09:48.628 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:09:48.628 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:09:48.628 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:09:48.634 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: expr 2 + 2 2026-02-21T12:09:48.635 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: seq 1 4 2026-02-21T12:09:48.636 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:09:48.636 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_1 td/divergent-priors/existing 2026-02-21T12:09:48.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:09:48.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_2 td/divergent-priors/existing 2026-02-21T12:09:48.675 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:09:48.675 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_3 td/divergent-priors/existing 2026-02-21T12:09:48.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:09:48.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_4 td/divergent-priors/existing 2026-02-21T12:09:48.712 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: seq 1 2 2026-02-21T12:09:48.713 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-21T12:09:48.713 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-21T12:09:48.730 INFO:tasks.workunit.client.0.trial058.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-21T12:09:48.731 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-21T12:09:48.731 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-21T12:09:48.748 INFO:tasks.workunit.client.0.trial058.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-21T12:09:48.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:605: TEST_divergent_2: rm -f td/divergent-priors/existing 2026-02-21T12:09:48.749 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-21T12:09:48.751 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: grep _merge_object_divergent_entries td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-21T12:09:48.754 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 27'106 (27'4) delete 1:70b3bf12:::existing_4:head by client.4545.0:1 2026-02-21T12:08:01.855435+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-21T12:09:48.754 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 20 _merge_object_divergent_entries: keeping 27'106 (27'4) delete 1:70b3bf12:::existing_4:head by client.4545.0:1 2026-02-21T12:08:01.855435+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-21T12:09:48.754 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:09:48.754 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 27'4 first_divergent_update: 27'106 last_divergent_update: 27'106 2026-02-21T12:09:48.754 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: more recent entry found: 43'101 (27'4) modify 1:70b3bf12:::existing_4:head by client.4654.0:1 2026-02-21T12:08:48.301110+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-21T12:09:48.754 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 27'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4532.0:1 2026-02-21T12:08:01.849480+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-21T12:09:48.754 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 20 _merge_object_divergent_entries: keeping 27'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4532.0:1 2026-02-21T12:08:01.849480+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-21T12:09:48.755 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:09:48.755 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 27'101 last_divergent_update: 27'101 2026-02-21T12:09:48.755 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-21T12:09:48.755 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-21T12:09:48.755 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 27'105 (27'3) delete 1:8881e6d8:::existing_3:head by client.4544.0:1 2026-02-21T12:08:01.854740+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-21T12:09:48.755 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 20 _merge_object_divergent_entries: keeping 27'105 (27'3) delete 1:8881e6d8:::existing_3:head by client.4544.0:1 2026-02-21T12:08:01.854740+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-21T12:09:48.755 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-21T12:09:48.755 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 27'3 first_divergent_update: 27'105 last_divergent_update: 27'105 2026-02-21T12:09:48.755 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-21T12:09:48.756 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-21T12:09:48.756 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 27'106 2026-02-21T12:09:48.756 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 27'105 (27'3) delete 1:8881e6d8:::existing_3:head by client.4544.0:1 2026-02-21T12:08:01.854740+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-21T12:09:48.756 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-21T12:09:48.756 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 27'3 <= info.log_tail 27'90 2026-02-21T12:09:48.756 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 27'103 (27'2) modify 1:97db2a0f:::existing_2:head by client.4538.0:1 2026-02-21T12:08:01.852045+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:09:48.756 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 20 _merge_object_divergent_entries: keeping 27'103 (27'2) modify 1:97db2a0f:::existing_2:head by client.4538.0:1 2026-02-21T12:08:01.852045+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:09:48.756 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:09:48.756 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 27'2 first_divergent_update: 27'103 last_divergent_update: 27'103 2026-02-21T12:09:48.756 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-21T12:09:48.757 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-21T12:09:48.757 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 27'106 2026-02-21T12:09:48.757 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 27'103 (27'2) modify 1:97db2a0f:::existing_2:head by client.4538.0:1 2026-02-21T12:08:01.852045+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:09:48.757 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-21T12:09:48.758 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 27'2 <= info.log_tail 27'90 2026-02-21T12:09:48.758 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 27'104 (27'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-21T12:08:01.852499+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:09:48.758 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 20 _merge_object_divergent_entries: keeping 27'104 (27'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-21T12:08:01.852499+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:09:48.759 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:09:48.760 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 27'1 first_divergent_update: 27'104 last_divergent_update: 27'104 2026-02-21T12:09:48.760 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-21T12:09:48.760 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-21T12:09:48.760 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 27'106 2026-02-21T12:09:48.760 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 27'104 (27'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-21T12:08:01.852499+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:09:48.761 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-21T12:09:48.761 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 27'1 <= info.log_tail 27'90 2026-02-21T12:09:48.761 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 27'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4533.0:1 2026-02-21T12:08:01.849891+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-21T12:09:48.761 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 20 _merge_object_divergent_entries: keeping 27'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4533.0:1 2026-02-21T12:08:01.849891+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-21T12:09:48.761 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:09:48.762 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 27'102 last_divergent_update: 27'102 2026-02-21T12:09:48.762 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-21T12:09:48.762 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:09:24.799+0000 7f223ace8640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-21T12:09:48.763 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-21T12:09:48.764 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-21T12:09:48.764 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-21T12:09:48.764 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-21T12:09:48.764 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:620: TEST_divergent_2: echo success 2026-02-21T12:09:48.765 INFO:tasks.workunit.client.0.trial058.stdout:success 2026-02-21T12:09:48.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:622: TEST_divergent_2: rm td/divergent-priors/td/divergent-priors/exp.43953.out 2026-02-21T12:09:48.766 INFO:tasks.workunit.client.0.trial058.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.43953.out': No such file or directory 2026-02-21T12:09:48.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:623: TEST_divergent_2: delete_pool test 2026-02-21T12:09:48.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-21T12:09:48.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-21T12:09:49.034 INFO:tasks.workunit.client.0.trial058.stderr:pool 'test' does not exist 2026-02-21T12:09:49.042 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:624: TEST_divergent_2: kill_daemons td/divergent-priors 2026-02-21T12:09:49.043 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:09:49.043 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:09:49.043 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:09:49.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:09:49.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:09:54.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:09:54.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-21T12:09:54.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-21T12:09:54.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:09:54.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-21T12:09:54.357 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:09:54.357 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:09:54.357 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:09:54.357 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:09:54.357 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:09:54.363 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:09:54.363 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:09:54.364 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:09:54.364 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:09:54.365 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:09:54.365 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:09:54.365 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:09:54.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:09:54.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:09:54.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:09:54.367 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:09:54.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:09:54.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:09:54.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-21T12:09:54.384 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:09:54.384 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:54.384 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:54.384 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.43953 2026-02-21T12:09:54.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:09:54.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:09:54.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-21T12:09:54.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-21T12:09:54.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-21T12:09:54.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-21T12:09:54.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-21T12:09:54.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:09:54.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-21T12:09:54.387 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:09:54.387 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:09:54.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:09:54.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:09:54.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:09:54.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:09:54.388 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:09:54.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:09:54.389 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:09:54.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:09:54.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:09:54.390 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:09:54.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:09:54.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:09:54.392 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:09:54.392 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:09:54.392 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:09:54.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:09:54.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-21T12:09:54.394 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:09:54.395 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:54.395 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:54.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.43953 2026-02-21T12:09:54.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:09:54.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:09:54.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-21T12:09:54.397 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-21T12:09:54.397 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:54.397 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:54.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.43953 2026-02-21T12:09:54.398 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-21T12:09:54.399 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-21T12:09:54.399 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-21T12:09:54.399 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-21T12:09:54.399 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_3 td/divergent-priors 2026-02-21T12:09:54.399 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:630: TEST_divergent_3: local dir=td/divergent-priors 2026-02-21T12:09:54.400 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: file_with_random_data 2026-02-21T12:09:54.400 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: file_with_random_data: local size_bytes=512 2026-02-21T12:09:54.400 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: mktemp 2026-02-21T12:09:54.400 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: local file=/tmp/tmp.hbE85LUcO4 2026-02-21T12:09:54.400 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.hbE85LUcO4 bs=512 count=1 2026-02-21T12:09:54.401 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records in 2026-02-21T12:09:54.401 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records out 2026-02-21T12:09:54.402 INFO:tasks.workunit.client.0.trial058.stderr:512 bytes copied, 5.0655e-05 s, 10.1 MB/s 2026-02-21T12:09:54.402 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: file_with_random_data: printf %s /tmp/tmp.hbE85LUcO4 2026-02-21T12:09:54.402 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: local dummyfile=/tmp/tmp.hbE85LUcO4 2026-02-21T12:09:54.402 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: file_with_random_data 1000 2026-02-21T12:09:54.402 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: file_with_random_data: local size_bytes=1000 2026-02-21T12:09:54.402 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: mktemp 2026-02-21T12:09:54.402 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: local file=/tmp/tmp.kweN47FVqk 2026-02-21T12:09:54.403 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.kweN47FVqk bs=1000 count=1 2026-02-21T12:09:54.404 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records in 2026-02-21T12:09:54.404 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records out 2026-02-21T12:09:54.404 INFO:tasks.workunit.client.0.trial058.stderr:1000 bytes (1.0 kB) copied, 5.8039e-05 s, 17.2 MB/s 2026-02-21T12:09:54.404 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: file_with_random_data: printf %s /tmp/tmp.kweN47FVqk 2026-02-21T12:09:54.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: local dummyfile2=/tmp/tmp.kweN47FVqk 2026-02-21T12:09:54.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:636: TEST_divergent_3: local num_osds=3 2026-02-21T12:09:54.404 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: expr 3 - 1 2026-02-21T12:09:54.405 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: seq 0 2 2026-02-21T12:09:54.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: local 'osds=0 2026-02-21T12:09:54.406 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:09:54.406 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:09:54.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: run_mon td/divergent-priors a 2026-02-21T12:09:54.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-21T12:09:54.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-21T12:09:54.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-21T12:09:54.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-21T12:09:54.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-21T12:09:54.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-21T12:09:54.427 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-21T12:09:54.427 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:09:54.427 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:09:54.427 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:09:54.427 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:54.427 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:54.427 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:09:54.428 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-21T12:09:54.453 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-21T12:09:54.455 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-21T12:09:54.455 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:09:54.455 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:09:54.455 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-21T12:09:54.455 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-21T12:09:54.455 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:09:54.455 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:09:54.455 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:09:54.456 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:09:54.456 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:54.456 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:54.456 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-mon.a.asok 2026-02-21T12:09:54.456 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:09:54.456 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.43953/ceph-mon.a.asok config get fsid 2026-02-21T12:09:54.497 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-21T12:09:54.497 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:09:54.497 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:09:54.497 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-21T12:09:54.498 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-21T12:09:54.498 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:09:54.498 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:09:54.498 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:09:54.498 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:09:54.498 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:54.498 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:54.498 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-mon.a.asok 2026-02-21T12:09:54.499 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:09:54.499 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.43953/ceph-mon.a.asok config get mon_host 2026-02-21T12:09:54.539 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:639: TEST_divergent_3: run_mgr td/divergent-priors x 2026-02-21T12:09:54.539 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-21T12:09:54.539 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-21T12:09:54.539 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-21T12:09:54.539 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-21T12:09:54.539 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-21T12:09:54.539 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-21T12:09:54.642 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-21T12:09:54.642 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:09:54.642 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:09:54.643 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:09:54.643 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:54.643 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:54.643 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:09:54.644 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:09:54.644 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:09:54.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-21T12:09:54.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 0 2026-02-21T12:09:54.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-21T12:09:54.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:09:54.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-21T12:09:54.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:09:54.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-21T12:09:54.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:09:54.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:09:54.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:09:54.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:09:54.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-21T12:09:54.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-21T12:09:54.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:09:54.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:09:54.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:09:54.666 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:09:54.666 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:09:54.666 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:09:54.666 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:09:54.666 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:54.667 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:54.667 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:09:54.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:09:54.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:09:54.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:09:54.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:09:54.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:09:54.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:09:54.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:09:54.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:09:54.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:09:54.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:09:54.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:09:54.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:09:54.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-21T12:09:54.668 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:09:54.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f771bd51-01b5-4958-8546-4ca193c1dcfd 2026-02-21T12:09:54.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 f771bd51-01b5-4958-8546-4ca193c1dcfd' 2026-02-21T12:09:54.669 INFO:tasks.workunit.client.0.trial058.stdout:add osd0 f771bd51-01b5-4958-8546-4ca193c1dcfd 2026-02-21T12:09:54.669 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:09:54.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCSoJlp7mukKRAAP9Zwlw/+pvXNhRvpkCx/3Q== 2026-02-21T12:09:54.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCSoJlp7mukKRAAP9Zwlw/+pvXNhRvpkCx/3Q=="}' 2026-02-21T12:09:54.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f771bd51-01b5-4958-8546-4ca193c1dcfd -i td/divergent-priors/0/new.json 2026-02-21T12:09:54.781 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:09:54.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-21T12:09:54.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCSoJlp7mukKRAAP9Zwlw/+pvXNhRvpkCx/3Q== --osd-uuid f771bd51-01b5-4958-8546-4ca193c1dcfd 2026-02-21T12:09:54.807 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:54.828+0000 7f7772431780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:54.809 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:54.830+0000 7f7772431780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:54.810 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:54.830+0000 7f7772431780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:54.810 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:54.831+0000 7f7772431780 -1 bdev(0x3834c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-21T12:09:54.810 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:54.831+0000 7f7772431780 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-21T12:09:55.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-21T12:09:55.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:09:55.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-21T12:09:55.245 INFO:tasks.workunit.client.0.trial058.stdout:adding osd0 key to auth repository 2026-02-21T12:09:55.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:09:55.351 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:09:55.351 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-21T12:09:55.351 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:09:55.351 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:09:55.351 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:09:55.351 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:09:55.369 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:55.390+0000 7f66a941e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:55.371 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:55.391+0000 7f66a941e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:55.372 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:55.392+0000 7f66a941e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:55.453 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-21T12:09:55.453 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:09:55.453 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:09:55.453 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:09:55.453 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:09:55.454 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:09:55.454 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:09:55.454 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:09:55.455 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:09:55.455 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:09:55.553 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:09:55.582 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:55.602+0000 7f66a941e780 -1 Falling back to public interface 2026-02-21T12:09:56.006 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:56.027+0000 7f66a941e780 -1 osd.0 0 log_to_monitors true 2026-02-21T12:09:56.554 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:09:56.554 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:09:56.555 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:09:56.555 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:09:56.555 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:09:56.556 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:09:56.651 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3879431275,v1:127.0.0.1:6801/3879431275] [v2:127.0.0.1:6802/3879431275,v1:127.0.0.1:6803/3879431275] exists,up f771bd51-01b5-4958-8546-4ca193c1dcfd 2026-02-21T12:09:56.656 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:09:56.656 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:09:56.656 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:09:56.656 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-21T12:09:56.656 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 1 2026-02-21T12:09:56.656 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-21T12:09:56.656 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:09:56.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-21T12:09:56.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:09:56.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-21T12:09:56.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:09:56.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:09:56.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:09:56.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:09:56.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-21T12:09:56.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-21T12:09:56.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:09:56.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:09:56.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:09:56.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:09:56.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:09:56.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:09:56.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:09:56.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:09:56.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:09:56.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:09:56.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-21T12:09:56.659 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:09:56.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9144ebf1-e1db-489a-82c1-79c50cc5771e 2026-02-21T12:09:56.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 9144ebf1-e1db-489a-82c1-79c50cc5771e' 2026-02-21T12:09:56.660 INFO:tasks.workunit.client.0.trial058.stdout:add osd1 9144ebf1-e1db-489a-82c1-79c50cc5771e 2026-02-21T12:09:56.660 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:09:56.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCUoJlpvCkRKRAAIbNmfHmnycGg7MI7oWojTg== 2026-02-21T12:09:56.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCUoJlpvCkRKRAAIbNmfHmnycGg7MI7oWojTg=="}' 2026-02-21T12:09:56.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9144ebf1-e1db-489a-82c1-79c50cc5771e -i td/divergent-priors/1/new.json 2026-02-21T12:09:56.773 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:09:56.779 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-21T12:09:56.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCUoJlpvCkRKRAAIbNmfHmnycGg7MI7oWojTg== --osd-uuid 9144ebf1-e1db-489a-82c1-79c50cc5771e 2026-02-21T12:09:56.799 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:56.820+0000 7f82a8a14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:56.800 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:56.821+0000 7f82a8a14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:56.801 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:56.822+0000 7f82a8a14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:56.802 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:56.822+0000 7f82a8a14780 -1 bdev(0x3380c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-21T12:09:56.802 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:56.822+0000 7f82a8a14780 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-21T12:09:57.126 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-21T12:09:57.126 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:09:57.126 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-21T12:09:57.127 INFO:tasks.workunit.client.0.trial058.stdout:adding osd1 key to auth repository 2026-02-21T12:09:57.127 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:09:57.465 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-21T12:09:57.466 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:09:57.467 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:09:57.467 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:09:57.467 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:09:57.467 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:09:57.484 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:57.505+0000 7f99d5013780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:57.485 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:57.506+0000 7f99d5013780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:57.486 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:57.507+0000 7f99d5013780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:57.623 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:57.643+0000 7f99d5013780 -1 Falling back to public interface 2026-02-21T12:09:57.693 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-21T12:09:57.693 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:09:57.693 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:09:57.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:09:57.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:09:57.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:09:57.694 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:09:57.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:09:57.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:09:57.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:09:57.921 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:57.941+0000 7f99d5013780 -1 osd.1 0 log_to_monitors true 2026-02-21T12:09:57.921 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:09:58.922 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:09:58.923 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:09:58.923 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:09:58.924 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:09:58.924 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:09:58.924 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:09:59.150 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/763868560,v1:127.0.0.1:6811/763868560] [v2:127.0.0.1:6812/763868560,v1:127.0.0.1:6813/763868560] exists,up 9144ebf1-e1db-489a-82c1-79c50cc5771e 2026-02-21T12:09:59.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:09:59.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:09:59.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:09:59.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-21T12:09:59.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 2 2026-02-21T12:09:59.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-21T12:09:59.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:09:59.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-21T12:09:59.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:09:59.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-21T12:09:59.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:09:59.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:09:59.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:09:59.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:09:59.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-21T12:09:59.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-21T12:09:59.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:09:59.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:09:59.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:09:59.156 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:09:59.156 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:09:59.156 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:09:59.156 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:09:59.156 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:09:59.156 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:09:59.156 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:09:59.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:09:59.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:09:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5bdbe793-0c4f-4318-b4c7-a1bb9acfc6fc 2026-02-21T12:09:59.158 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 5bdbe793-0c4f-4318-b4c7-a1bb9acfc6fc' 2026-02-21T12:09:59.158 INFO:tasks.workunit.client.0.trial058.stdout:add osd2 5bdbe793-0c4f-4318-b4c7-a1bb9acfc6fc 2026-02-21T12:09:59.158 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:09:59.166 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCXoJlp3AUkCxAAWONEbVDov+RyAbKkMoml2A== 2026-02-21T12:09:59.166 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCXoJlp3AUkCxAAWONEbVDov+RyAbKkMoml2A=="}' 2026-02-21T12:09:59.166 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5bdbe793-0c4f-4318-b4c7-a1bb9acfc6fc -i td/divergent-priors/2/new.json 2026-02-21T12:09:59.394 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:09:59.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-21T12:09:59.402 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCXoJlp3AUkCxAAWONEbVDov+RyAbKkMoml2A== --osd-uuid 5bdbe793-0c4f-4318-b4c7-a1bb9acfc6fc 2026-02-21T12:09:59.421 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:59.442+0000 7f690445f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:59.422 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:59.443+0000 7f690445f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:59.423 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:59.444+0000 7f690445f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:09:59.424 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:59.444+0000 7f690445f780 -1 bdev(0x26cac00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-21T12:09:59.424 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:09:59.444+0000 7f690445f780 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-21T12:09:59.741 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-21T12:09:59.742 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:09:59.742 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-21T12:09:59.743 INFO:tasks.workunit.client.0.trial058.stdout:adding osd2 key to auth repository 2026-02-21T12:09:59.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:10:00.060 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:10:00.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-21T12:10:00.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:10:00.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:10:00.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:10:00.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:10:00.077 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:00.098+0000 7f0ff5a11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:10:00.078 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:00.099+0000 7f0ff5a11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:10:00.079 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:00.100+0000 7f0ff5a11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:10:00.244 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:00.264+0000 7f0ff5a11780 -1 Falling back to public interface 2026-02-21T12:10:00.291 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-21T12:10:00.291 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:10:00.292 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:10:00.292 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:10:00.292 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:10:00.292 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:10:00.292 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:10:00.293 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:10:00.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:10:00.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:10:00.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:10:00.602 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:00.623+0000 7f0ff5a11780 -1 osd.2 0 log_to_monitors true 2026-02-21T12:10:01.520 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:10:01.521 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:10:01.521 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:10:01.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:10:01.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:10:01.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:10:01.751 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3348013215,v1:127.0.0.1:6819/3348013215] [v2:127.0.0.1:6820/3348013215,v1:127.0.0.1:6821/3348013215] exists,up 5bdbe793-0c4f-4318-b4c7-a1bb9acfc6fc 2026-02-21T12:10:01.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:10:01.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:10:01.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:10:01.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:645: TEST_divergent_3: ceph osd set noout 2026-02-21T12:10:02.068 INFO:tasks.workunit.client.0.trial058.stderr:noout is set 2026-02-21T12:10:02.079 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:646: TEST_divergent_3: ceph osd set noin 2026-02-21T12:10:02.373 INFO:tasks.workunit.client.0.trial058.stderr:noin is set 2026-02-21T12:10:02.380 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:647: TEST_divergent_3: ceph osd set nodown 2026-02-21T12:10:02.678 INFO:tasks.workunit.client.0.trial058.stderr:nodown is set 2026-02-21T12:10:02.685 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:648: TEST_divergent_3: create_pool test 1 1 2026-02-21T12:10:02.685 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-21T12:10:02.943 INFO:tasks.workunit.client.0.trial058.stderr:pool 'test' already exists 2026-02-21T12:10:02.950 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-21T12:10:03.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:649: TEST_divergent_3: ceph osd pool set test size 3 2026-02-21T12:10:04.267 INFO:tasks.workunit.client.0.trial058.stderr:set pool 1 size to 3 2026-02-21T12:10:04.277 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:650: TEST_divergent_3: ceph osd pool set test min_size 2 2026-02-21T12:10:04.570 INFO:tasks.workunit.client.0.trial058.stderr:set pool 1 min_size to 2 2026-02-21T12:10:04.580 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:653: TEST_divergent_3: ceph osd pool set test pg_autoscale_mode on 2026-02-21T12:10:04.876 INFO:tasks.workunit.client.0.trial058.stderr:set pool 1 pg_autoscale_mode to on 2026-02-21T12:10:04.886 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:655: TEST_divergent_3: divergent=-1 2026-02-21T12:10:04.886 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: date +%s 2026-02-21T12:10:04.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: start_time=1771675804 2026-02-21T12:10:04.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: max_duration=300 2026-02-21T12:10:04.888 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' -1 -le -1 ']' 2026-02-21T12:10:04.888 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: flush_pg_stats 2026-02-21T12:10:04.888 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:10:04.888 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:10:05.113 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:10:05.113 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:10:05.113 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:10:05.113 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:10:05.113 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:10:05.113 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:10:05.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836484 2026-02-21T12:10:05.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836484 2026-02-21T12:10:05.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836484' 2026-02-21T12:10:05.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:10:05.180 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:10:05.250 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=38654705668 2026-02-21T12:10:05.250 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 38654705668 2026-02-21T12:10:05.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836484 1-38654705668' 2026-02-21T12:10:05.251 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:10:05.251 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:10:05.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=55834574852 2026-02-21T12:10:05.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 55834574852 2026-02-21T12:10:05.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836484 1-38654705668 2-55834574852' 2026-02-21T12:10:05.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:10:05.317 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836484 2026-02-21T12:10:05.317 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:10:05.318 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:10:05.318 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836484 2026-02-21T12:10:05.318 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:10:05.319 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836484 2026-02-21T12:10:05.320 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836484 2026-02-21T12:10:05.320 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-21T12:10:05.320 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:10:05.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-21T12:10:05.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:10:06.547 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:10:06.547 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:10:06.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-21T12:10:06.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:10:06.779 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-38654705668 2026-02-21T12:10:06.779 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:10:06.779 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:10:06.780 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-38654705668 2026-02-21T12:10:06.780 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:10:06.781 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=38654705668 2026-02-21T12:10:06.781 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-21T12:10:06.781 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 38654705668 2026-02-21T12:10:06.781 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:10:07.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-21T12:10:07.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:10:07.008 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-55834574852 2026-02-21T12:10:07.009 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:10:07.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:10:07.010 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-55834574852 2026-02-21T12:10:07.010 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:10:07.011 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=55834574852 2026-02-21T12:10:07.012 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 55834574852 2026-02-21T12:10:07.012 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 55834574852' 2026-02-21T12:10:07.012 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:10:07.240 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-21T12:10:07.240 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:662: TEST_divergent_3: wait_for_clean 2026-02-21T12:10:07.241 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:10:07.241 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:10:07.241 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:10:07.241 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-21T12:10:07.241 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:10:07.241 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:10:07.242 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:10:07.242 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:10:07.242 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:10:07.326 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-21T12:10:07.327 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:10:07.327 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:10:07.327 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:10:07.327 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:10:07.327 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:10:07.559 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:10:07.559 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:10:07.559 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:10:07.559 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:10:07.559 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:10:07.559 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:10:07.626 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836487 2026-02-21T12:10:07.626 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836487 2026-02-21T12:10:07.626 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836487' 2026-02-21T12:10:07.626 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:10:07.626 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:10:07.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=38654705670 2026-02-21T12:10:07.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 38654705670 2026-02-21T12:10:07.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-21T12:10:07.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:10:07.695 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:10:07.763 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=55834574855 2026-02-21T12:10:07.763 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 55834574855 2026-02-21T12:10:07.764 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-55834574855' 2026-02-21T12:10:07.764 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:10:07.764 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836487 2026-02-21T12:10:07.764 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:10:07.765 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:10:07.765 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836487 2026-02-21T12:10:07.765 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:10:07.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836487 2026-02-21T12:10:07.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-21T12:10:07.767 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836487 2026-02-21T12:10:07.767 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:10:08.004 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836484 -lt 21474836487 2026-02-21T12:10:08.004 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:10:09.005 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:10:09.005 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:10:09.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-21T12:10:09.232 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:10:09.233 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-38654705670 2026-02-21T12:10:09.233 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:10:09.233 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:10:09.234 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-38654705670 2026-02-21T12:10:09.234 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:10:09.235 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=38654705670 2026-02-21T12:10:09.235 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-21T12:10:09.236 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 38654705670 2026-02-21T12:10:09.236 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:10:09.464 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-21T12:10:09.464 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:10:09.464 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-55834574855 2026-02-21T12:10:09.465 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:10:09.465 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:10:09.466 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-55834574855 2026-02-21T12:10:09.466 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:10:09.467 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=55834574855 2026-02-21T12:10:09.467 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 55834574855' 2026-02-21T12:10:09.467 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 55834574855 2026-02-21T12:10:09.467 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:10:09.691 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 55834574855 -lt 55834574855 2026-02-21T12:10:09.692 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:10:09.693 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:09.693 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:10.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:10:10.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:10:10.010 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:10:10.010 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:10:10.010 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:10:10.010 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:10:10.010 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:10:10.010 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:10:10.234 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-21T12:10:10.235 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:10:10.235 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:10.235 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:10.554 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-21T12:10:10.555 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:10:10.555 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:10:10.555 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: ceph pg dump pgs --format=json 2026-02-21T12:10:10.555 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: jq '.pg_stats[0].up_primary' 2026-02-21T12:10:10.771 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:10:10.779 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: divergent=1 2026-02-21T12:10:10.779 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:666: TEST_divergent_3: echo 'primary and soon to be divergent is 1' 2026-02-21T12:10:10.779 INFO:tasks.workunit.client.0.trial058.stdout:primary and soon to be divergent is 1 2026-02-21T12:10:10.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:667: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:10:10.995 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:10:10.996 INFO:tasks.workunit.client.0.trial058.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-21T12:10:03.583097+0000 0'0 29:28 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 periodic scrub scheduled @ 2026-02-22T14:50:15.708331+0000 0 0 2026-02-21T12:10:10.996 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:10:10.996 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:10:10.996 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:10:11.002 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: date +%s 2026-02-21T12:10:11.003 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: current_time=1771675811 2026-02-21T12:10:11.003 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: expr 1771675811 - 1771675804 2026-02-21T12:10:11.005 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: elapsed_time=7 2026-02-21T12:10:11.005 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: '[' 7 -gt 300 ']' 2026-02-21T12:10:11.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' 1 -le -1 ']' 2026-02-21T12:10:11.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:677: TEST_divergent_3: local non_divergent= 2026-02-21T12:10:11.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-21T12:10:11.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 0 = 1 ']' 2026-02-21T12:10:11.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0' 2026-02-21T12:10:11.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-21T12:10:11.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 1 = 1 ']' 2026-02-21T12:10:11.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: continue 2026-02-21T12:10:11.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-21T12:10:11.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 2 = 1 ']' 2026-02-21T12:10:11.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0 2' 2026-02-21T12:10:11.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: echo 'writing initial objects' 2026-02-21T12:10:11.007 INFO:tasks.workunit.client.0.trial058.stdout:writing initial objects 2026-02-21T12:10:11.007 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: seq 1 100 2026-02-21T12:10:11.007 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.007 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.025 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.025 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_3 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.063 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.063 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.081 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.081 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_5 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_6 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_7 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_8 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_9 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_10 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.189 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.190 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_11 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.208 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.208 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_12 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.226 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.226 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_13 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_14 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.262 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.262 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_15 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.280 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.280 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_16 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_17 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.316 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.316 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_18 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.333 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.334 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_19 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.352 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.352 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_20 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_21 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_22 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_23 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.424 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.424 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_24 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.443 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.443 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_25 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.462 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.462 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_26 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_27 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_28 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_29 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.538 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.538 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_30 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.556 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.556 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_31 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.575 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.575 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_32 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.593 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.593 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_33 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.612 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_34 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.631 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.631 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_35 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_36 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_37 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.687 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.687 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_38 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.706 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.706 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_39 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.725 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.725 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_40 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.744 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.744 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_41 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.763 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.763 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_42 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.782 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.782 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_43 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.801 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.801 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_44 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.819 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.819 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_45 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.838 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.838 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_46 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.856 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.857 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_47 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.875 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.875 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_48 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.893 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.893 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_49 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_50 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_51 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.950 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.950 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_52 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.969 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.970 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_53 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:11.987 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:11.988 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_54 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.007 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.007 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_55 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.025 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.025 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_56 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.045 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.045 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_57 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.063 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_58 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.083 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.083 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_59 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.102 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.102 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_60 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.120 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.121 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_61 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.139 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.139 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_62 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.158 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.159 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_63 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_64 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.196 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.196 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_65 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.215 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.215 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_66 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.233 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.233 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_67 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_68 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.270 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.270 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_69 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.289 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.289 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_70 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.308 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.308 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_71 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.326 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.327 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_72 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.344 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.345 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_73 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.364 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.364 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_74 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.382 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_75 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.402 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.402 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_76 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.421 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.421 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_77 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.440 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.440 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_78 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.458 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.459 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_79 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.477 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.477 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_80 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.496 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.497 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_81 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.515 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.515 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_82 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.534 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.534 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_83 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.553 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.553 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_84 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.572 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.572 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_85 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.590 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.591 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_86 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.610 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.610 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_87 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.629 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.629 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_88 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.648 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.648 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_89 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_90 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.685 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.685 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_91 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.705 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_92 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.722 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.722 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_93 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.741 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.741 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_94 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_95 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_96 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.797 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.797 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_97 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.816 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.816 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_98 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.837 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.837 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_99 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.856 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-21T12:10:12.856 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_100 /tmp/tmp.hbE85LUcO4 2026-02-21T12:10:12.874 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-21T12:10:12.875 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: wait_for_clean 2026-02-21T12:10:12.875 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:10:12.875 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:10:12.875 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:10:12.875 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-21T12:10:12.876 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:10:12.876 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:10:12.876 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:10:12.876 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:10:12.876 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:10:12.929 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-21T12:10:12.929 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:10:12.929 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:10:12.929 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:10:12.929 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:10:12.930 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:10:13.160 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:10:13.161 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:10:13.161 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:10:13.161 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:10:13.161 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:10:13.161 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:10:13.227 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836490 2026-02-21T12:10:13.227 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836490 2026-02-21T12:10:13.228 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836490' 2026-02-21T12:10:13.228 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:10:13.228 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:10:13.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=38654705673 2026-02-21T12:10:13.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 38654705673 2026-02-21T12:10:13.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836490 1-38654705673' 2026-02-21T12:10:13.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:10:13.295 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:10:13.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=55834574858 2026-02-21T12:10:13.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 55834574858 2026-02-21T12:10:13.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836490 1-38654705673 2-55834574858' 2026-02-21T12:10:13.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:10:13.367 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836490 2026-02-21T12:10:13.367 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:10:13.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:10:13.368 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836490 2026-02-21T12:10:13.368 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:10:13.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836490 2026-02-21T12:10:13.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-21T12:10:13.370 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836490 2026-02-21T12:10:13.370 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:10:13.594 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-21T12:10:13.594 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:10:14.595 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:10:14.596 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:10:14.833 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-21T12:10:14.833 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:10:14.833 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-38654705673 2026-02-21T12:10:14.834 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:10:14.834 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:10:14.835 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-38654705673 2026-02-21T12:10:14.835 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:10:14.836 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=38654705673 2026-02-21T12:10:14.837 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 38654705673 2026-02-21T12:10:14.838 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-21T12:10:14.838 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:10:15.063 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 38654705674 -lt 38654705673 2026-02-21T12:10:15.063 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:10:15.063 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-55834574858 2026-02-21T12:10:15.063 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:10:15.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:10:15.065 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-55834574858 2026-02-21T12:10:15.065 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:10:15.066 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=55834574858 2026-02-21T12:10:15.066 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 55834574858' 2026-02-21T12:10:15.066 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 55834574858 2026-02-21T12:10:15.066 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:10:15.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 55834574858 -lt 55834574858 2026-02-21T12:10:15.296 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:10:15.297 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:15.297 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:15.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:10:15.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:10:15.613 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:10:15.614 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:10:15.614 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:10:15.614 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:10:15.614 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:10:15.614 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:10:15.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-21T12:10:15.843 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:10:15.843 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:15.843 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:16.158 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-21T12:10:16.158 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:10:16.158 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:10:16.158 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: get_pg test existing_1 2026-02-21T12:10:16.158 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-21T12:10:16.158 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-21T12:10:16.158 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-21T12:10:16.158 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-21T12:10:16.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: local pgid=1.0 2026-02-21T12:10:16.389 INFO:tasks.workunit.client.0.trial058.stdout:blackholing osds 0 2 2026-02-21T12:10:16.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: echo 'blackholing osds 0 2' 2026-02-21T12:10:16.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:699: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:10:16.605 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:10:16.605 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-21T12:10:03.583097+0000 29'100 29:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 periodic scrub scheduled @ 2026-02-22T14:50:15.708331+0000 0 0 2026-02-21T12:10:16.605 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:10:16.605 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:10:16.606 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:10:16.612 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-21T12:10:16.613 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.0 2026-02-21T12:10:16.614 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-21T12:10:16.614 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-21T12:10:16.614 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:10:16.614 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:10:16.614 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:10:16.614 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.0.asok 2026-02-21T12:10:16.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-21T12:10:16.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-21T12:10:16.656 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:10:16.656 INFO:tasks.workunit.client.0.trial058.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-21T12:10:16.657 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:10:16.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-21T12:10:16.660 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.2 2026-02-21T12:10:16.660 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-21T12:10:16.660 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-21T12:10:16.661 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:10:16.661 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:10:16.661 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:10:16.661 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.2.asok 2026-02-21T12:10:16.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-21T12:10:16.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-21T12:10:16.704 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:10:16.704 INFO:tasks.workunit.client.0.trial058.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-21T12:10:16.704 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:10:16.707 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:706: TEST_divergent_3: echo 'create new divergent objects' 2026-02-21T12:10:16.707 INFO:tasks.workunit.client.0.trial058.stdout:create new divergent objects 2026-02-21T12:10:16.708 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: seq 1 2 2026-02-21T12:10:16.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-21T12:10:16.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-21T12:10:16.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_1 2026-02-21T12:10:16.710 INFO:tasks.workunit.client.0.trial058.stdout:writing divergent objects 2026-02-21T12:10:16.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:712: TEST_divergent_3: echo 'writing divergent objects' 2026-02-21T12:10:16.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_2 2026-02-21T12:10:16.712 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: seq 1 2 2026-02-21T12:10:16.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-21T12:10:16.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-21T12:10:16.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.kweN47FVqk 2026-02-21T12:10:16.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:718: TEST_divergent_3: echo 'remove divergent objects' 2026-02-21T12:10:16.713 INFO:tasks.workunit.client.0.trial058.stdout:remove divergent objects 2026-02-21T12:10:16.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.kweN47FVqk 2026-02-21T12:10:16.716 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: seq 1 2 2026-02-21T12:10:16.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-21T12:10:16.716 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 1 + 2 2026-02-21T12:10:16.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=3 2026-02-21T12:10:16.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-21T12:10:16.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_3 2026-02-21T12:10:16.716 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 2 + 2 2026-02-21T12:10:16.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=4 2026-02-21T12:10:16.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:724: TEST_divergent_3: sleep 10 2026-02-21T12:10:16.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_4 2026-02-21T12:10:26.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:725: TEST_divergent_3: killall -9 rados 2026-02-21T12:10:26.742 INFO:tasks.workunit.client.0.trial058.stderr:rados: no process found 2026-02-21T12:10:26.742 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: echo 'killing all the osds' 2026-02-21T12:10:26.743 INFO:tasks.workunit.client.0.trial058.stdout:killing all the osds 2026-02-21T12:10:26.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:10:26.959 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:10:26.959 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-21T12:10:03.583097+0000 29'106 29:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 periodic scrub scheduled @ 2026-02-22T14:50:15.708331+0000 0 0 2026-02-21T12:10:26.959 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:10:26.959 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:10:26.959 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:10:26.965 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:730: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd 2026-02-21T12:10:26.966 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:10:26.966 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:10:26.967 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:10:26.967 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:10:26.967 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:10:27.074 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:10:27.075 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-21T12:10:27.075 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.0 2026-02-21T12:10:27.356 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already down. 2026-02-21T12:10:27.364 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-21T12:10:27.364 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.1 2026-02-21T12:10:27.642 INFO:tasks.workunit.client.0.trial058.stderr:osd.1 is already down. 2026-02-21T12:10:27.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-21T12:10:27.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.2 2026-02-21T12:10:27.933 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already down. 2026-02-21T12:10:27.941 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-21T12:10:27.941 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.0 2026-02-21T12:10:28.218 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already out. 2026-02-21T12:10:28.225 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-21T12:10:28.225 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.2 2026-02-21T12:10:28.507 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already out. 2026-02-21T12:10:28.514 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: echo 'bringing up non_divergent 0 2' 2026-02-21T12:10:28.515 INFO:tasks.workunit.client.0.trial058.stdout:bringing up non_divergent 0 2 2026-02-21T12:10:28.515 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:742: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:10:28.733 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:10:28.733 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-21T12:10:03.583097+0000 29'106 29:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 periodic scrub scheduled @ 2026-02-22T14:50:15.708331+0000 0 0 2026-02-21T12:10:28.733 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:10:28.733 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:10:28.733 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:10:28.742 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 0 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:10:28.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:10:28.744 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:10:28.744 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:10:28.744 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:10:28.744 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-21T12:10:28.744 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-21T12:10:28.744 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:10:28.744 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:10:28.744 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-21T12:10:28.744 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-21T12:10:28.744 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:10:28.744 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:10:28.744 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:10:28.761 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:28.782+0000 7f9abf852780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:10:28.763 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:28.784+0000 7f9abf852780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:10:28.764 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:28.785+0000 7f9abf852780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:10:28.883 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:28.903+0000 7f9abf852780 -1 Falling back to public interface 2026-02-21T12:10:28.973 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-21T12:10:28.973 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:10:28.973 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:10:28.973 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:10:28.973 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:10:28.973 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:10:28.973 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:10:28.973 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:10:28.973 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:10:28.973 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:10:29.213 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:10:29.229 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:29.249+0000 7f9abf852780 -1 osd.0 29 log_to_monitors true 2026-02-21T12:10:30.215 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:10:30.215 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:10:30.215 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:10:30.216 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:10:30.216 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:10:30.216 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:10:30.445 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6800/3535133695,v1:127.0.0.1:6801/3535133695] [v2:127.0.0.1:6802/3535133695,v1:127.0.0.1:6803/3535133695] exists,up f771bd51-01b5-4958-8546-4ca193c1dcfd 2026-02-21T12:10:30.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:10:30.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:10:30.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:10:30.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-21T12:10:30.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 2 2026-02-21T12:10:30.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:10:30.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:10:30.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-21T12:10:30.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:10:30.447 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:10:30.448 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:10:30.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:10:30.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-21T12:10:30.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-21T12:10:30.449 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:10:30.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:10:30.449 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-21T12:10:30.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-21T12:10:30.450 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:10:30.450 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:10:30.450 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:10:30.467 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:30.488+0000 7f5aec217780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:10:30.469 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:30.489+0000 7f5aec217780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:10:30.469 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:30.490+0000 7f5aec217780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:10:30.599 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:30.619+0000 7f5aec217780 -1 Falling back to public interface 2026-02-21T12:10:30.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-21T12:10:30.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:10:30.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:10:30.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:10:30.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:10:30.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:10:30.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:10:30.678 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:10:30.679 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:10:30.679 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:10:30.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:10:30.922 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:10:30.943+0000 7f5aec217780 -1 osd.2 29 log_to_monitors true 2026-02-21T12:10:31.911 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:10:31.911 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:10:31.911 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:10:31.911 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:10:31.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:10:31.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:10:32.140 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up out weight 0 up_from 39 up_thru 0 down_at 32 last_clean_interval [13,29) [v2:127.0.0.1:6810/2785589244,v1:127.0.0.1:6811/2785589244] [v2:127.0.0.1:6812/2785589244,v1:127.0.0.1:6813/2785589244] exists,up 5bdbe793-0c4f-4318-b4c7-a1bb9acfc6fc 2026-02-21T12:10:32.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:10:32.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:10:32.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:10:32.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-21T12:10:32.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.0 2026-02-21T12:10:32.389 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already in. 2026-02-21T12:10:32.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-21T12:10:32.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.2 2026-02-21T12:10:32.676 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already in. 2026-02-21T12:10:32.684 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-21T12:10:32.685 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: wait_for_clean 2026-02-21T12:10:32.685 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:10:32.685 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:10:32.685 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:10:32.685 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-21T12:10:32.686 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:10:32.686 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:10:32.686 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:10:32.686 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:10:32.687 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:10:32.739 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-21T12:10:32.739 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:10:32.739 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:10:32.739 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:10:32.740 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:10:32.740 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:10:32.966 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:10:32.966 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:10:32.966 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:10:32.966 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:10:32.966 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:10:32.967 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:10:33.037 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=154618822659 2026-02-21T12:10:33.037 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 154618822659 2026-02-21T12:10:33.037 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-154618822659' 2026-02-21T12:10:33.037 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:10:33.038 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:10:33.086 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq= 2026-02-21T12:10:33.086 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: true 2026-02-21T12:10:33.086 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z '' 2026-02-21T12:10:33.086 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2289: flush_pg_stats: continue 2026-02-21T12:10:33.086 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:10:33.087 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:10:33.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=167503724547 2026-02-21T12:10:33.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 167503724547 2026-02-21T12:10:33.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-154618822659 2-167503724547' 2026-02-21T12:10:33.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:10:33.157 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-154618822659 2026-02-21T12:10:33.157 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:10:33.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:10:33.158 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-154618822659 2026-02-21T12:10:33.158 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:10:33.159 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=154618822659 2026-02-21T12:10:33.159 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 154618822659' 2026-02-21T12:10:33.159 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 154618822659 2026-02-21T12:10:33.160 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:10:33.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 1 -lt 154618822659 2026-02-21T12:10:33.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:10:34.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:10:34.389 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:10:34.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 1 -lt 154618822659 2026-02-21T12:10:34.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:10:35.622 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-21T12:10:35.622 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:10:35.851 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 154618822660 -lt 154618822659 2026-02-21T12:10:35.851 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:10:35.852 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-167503724547 2026-02-21T12:10:35.852 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:10:35.852 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:10:35.853 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-167503724547 2026-02-21T12:10:35.853 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:10:35.854 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=167503724547 2026-02-21T12:10:35.854 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 167503724547' 2026-02-21T12:10:35.854 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 167503724547 2026-02-21T12:10:35.855 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:10:36.083 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 167503724547 -lt 167503724547 2026-02-21T12:10:36.084 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:10:36.084 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:36.085 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:36.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:10:36.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:10:36.404 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:10:36.404 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:10:36.405 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:10:36.405 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:10:36.405 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:10:36.405 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:10:36.630 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:10:36.631 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:10:36.631 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:36.631 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:36.947 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:10:36.948 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-21T12:10:36.948 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-21T12:10:36.948 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-21T12:10:36.948 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:10:36.948 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-21T12:10:37.049 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:10:37.049 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:10:37.049 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:10:37.049 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:10:37.049 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:10:37.049 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:10:37.050 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:10:37.050 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:10:37.273 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:10:37.273 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:10:37.274 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:37.274 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:37.592 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:10:37.592 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:10:37.592 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:10:37.592 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:10:37.592 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:10:37.592 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:10:37.592 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:10:37.592 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:10:37.593 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:10:37.907 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:10:37.907 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:10:37.907 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-21T12:10:37.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:10:37.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-21T12:10:38.108 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:10:38.108 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:10:38.109 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:10:38.109 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:10:38.110 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:10:38.110 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:10:38.110 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:10:38.110 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:10:38.333 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:10:38.334 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:10:38.334 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:38.334 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:38.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:10:38.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:10:38.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:10:38.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:10:38.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:10:38.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:10:38.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:10:38.649 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:10:38.649 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:10:38.963 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:10:38.964 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:10:38.964 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-21T12:10:38.964 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:10:38.964 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-21T12:10:39.364 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:10:39.364 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:10:39.365 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:10:39.365 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:10:39.365 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:10:39.365 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:10:39.365 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:10:39.365 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:10:39.590 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:10:39.592 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:10:39.592 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:39.592 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:39.911 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:10:39.911 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:10:39.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:10:39.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:10:39.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:10:39.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:10:39.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:10:39.912 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:10:39.912 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:10:40.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:10:40.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:10:40.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-21T12:10:40.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:10:40.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-21T12:10:41.029 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:10:41.030 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:10:41.031 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:10:41.031 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:10:41.031 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:10:41.031 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:10:41.031 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:10:41.031 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:10:41.255 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:10:41.255 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:10:41.256 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:41.256 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:41.570 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:10:41.571 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:10:41.571 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:10:41.571 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:10:41.571 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:10:41.571 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:10:41.571 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:10:41.571 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:10:41.571 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:10:41.886 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:10:41.886 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:10:41.886 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-21T12:10:41.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:10:41.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-21T12:10:43.488 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:10:43.488 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:10:43.489 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:10:43.489 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:10:43.489 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:10:43.489 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:10:43.489 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:10:43.489 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:10:43.713 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:10:43.714 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:10:43.714 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:43.715 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:44.027 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:10:44.027 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:10:44.027 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:10:44.027 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:10:44.027 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:10:44.027 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:10:44.027 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:10:44.027 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:10:44.027 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:10:44.341 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:10:44.342 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:10:44.342 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-21T12:10:44.342 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:10:44.342 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-21T12:10:47.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:10:47.544 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:10:47.544 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:10:47.545 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:10:47.545 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:10:47.545 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:10:47.545 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:10:47.545 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:10:47.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:10:47.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:10:47.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:47.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:48.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:10:48.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:10:48.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:10:48.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:10:48.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:10:48.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:10:48.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:10:48.091 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:10:48.091 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:10:48.410 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:10:48.410 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:10:48.410 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-21T12:10:48.410 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:10:48.410 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-21T12:10:54.814 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:10:54.814 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:10:54.815 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:10:54.815 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:10:54.815 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:10:54.815 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:10:54.816 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:10:54.816 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:10:55.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:10:55.042 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:10:55.042 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:10:55.043 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:10:55.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:10:55.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:10:55.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:10:55.361 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:10:55.361 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:10:55.361 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:10:55.361 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:10:55.361 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:10:55.361 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:10:55.680 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:10:55.680 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:10:55.680 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-21T12:10:55.680 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:10:55.680 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-21T12:11:02.981 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:11:02.982 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:11:02.982 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:11:02.982 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:11:02.982 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:11:02.982 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:11:02.983 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:11:02.983 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:11:03.213 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:11:03.213 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:11:03.213 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:11:03.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:11:03.528 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-21T12:11:03.528 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:11:03.529 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:11:03.529 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:11:03.529 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:11:03.529 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:11:03.529 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:11:03.529 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:11:03.529 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:11:03.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:11:03.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:11:03.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-21T12:11:03.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-21T12:11:04.158 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_fingerprint": "abd1f11e-8cb1-44fa-ae1e-22f8bd855369", 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "version": "20.3.0-5397-gf7273f30", 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "commit": "f7273f3049146bdd7fa7b4a400114872a50228e9", 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "timestamp": "2026-02-21T12:11:04.169774+0000", 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "tag": "", 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "health": { 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "status": "HEALTH_WARN", 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "checks": { 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "OSDMAP_FLAGS": { 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "count": 17 2026-02-21T12:11:04.159 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [], 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "OSD_DOWN": { 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "message": "1 osds down", 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "count": 1 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "message": "osd.1 (root=default,host=trial058) is down" 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "PG_DEGRADED": { 2026-02-21T12:11:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:11:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:11:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-21T12:11:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "count": 32 2026-02-21T12:11:04.161 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:11:04.161 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.0 is active+undersized+degraded+wait, acting [0,2]" 2026-02-21T12:11:04.161 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.162 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.162 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.162 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.162 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.162 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.162 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.162 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.163 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.163 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.163 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.163 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.163 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.163 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.163 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.163 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.164 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.164 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.164 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.164 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.164 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.164 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.164 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.164 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.165 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.166 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.166 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.166 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.166 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.166 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.166 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.166 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.166 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.167 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.167 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.167 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.167 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.167 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.167 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.167 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.167 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.168 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.169 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.169 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.169 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.169 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:04.169 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.169 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:11:04.169 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.169 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "mutes": [] 2026-02-21T12:11:04.170 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_first_committed": 1, 2026-02-21T12:11:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_last_committed": 1, 2026-02-21T12:11:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "monmap": { 2026-02-21T12:11:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:11:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:11:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:09:54.441708Z", 2026-02-21T12:11:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:09:54.441708Z", 2026-02-21T12:11:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release": 20, 2026-02-21T12:11:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-21T12:11:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "election_strategy": 1, 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "disallowed_leaders": "", 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": false, 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "tiebreaker_mon": "", 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "removed_ranks": "", 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "features": { 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "persistent": [ 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "kraken", 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "luminous", 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "mimic", 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap-prune", 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "nautilus", 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "octopus", 2026-02-21T12:11:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "pacific", 2026-02-21T12:11:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "elector-pinging", 2026-02-21T12:11:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "quincy", 2026-02-21T12:11:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "reef", 2026-02-21T12:11:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "squid", 2026-02-21T12:11:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "tentacle", 2026-02-21T12:11:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "nvmeof_beacon_diff" 2026-02-21T12:11:04.172 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "optional": [] 2026-02-21T12:11:04.172 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "mons": [ 2026-02-21T12:11:04.172 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "rank": 0, 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "name": "a", 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115", 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 0 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115/0", 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-21T12:11:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "priority": 0, 2026-02-21T12:11:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 0, 2026-02-21T12:11:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "time_added": "2026-02-21T12:09:54:441704+0000", 2026-02-21T12:11:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "crush_location": [] 2026-02-21T12:11:04.174 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.174 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.174 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "quorum": [ 2026-02-21T12:11:04.174 INFO:tasks.workunit.client.0.trial058.stdout: 0 2026-02-21T12:11:04.174 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap": { 2026-02-21T12:11:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 45, 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:09:54.476791+0000", 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:10:58.853579+0000", 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "last_up_change": "2026-02-21T12:10:31.086587+0000", 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "last_in_change": "2026-02-21T12:10:32.632502+0000", 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "flags_num": 5800384, 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "flags_set": [ 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "nodown", 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "noin", 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "noout", 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "pglog_hardlimit", 2026-02-21T12:11:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snapdirs", 2026-02-21T12:11:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "recovery_deletes", 2026-02-21T12:11:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "sortbitwise" 2026-02-21T12:11:04.176 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "crush_version": 9, 2026-02-21T12:11:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "full_ratio": 0.99000000953674316, 2026-02-21T12:11:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-21T12:11:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-21T12:11:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_snapshot": "", 2026-02-21T12:11:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "pool_max": 1, 2026-02-21T12:11:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "max_osd": 3, 2026-02-21T12:11:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "require_min_compat_client": "luminous", 2026-02-21T12:11:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "min_compat_client": "jewel", 2026-02-21T12:11:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "require_osd_release": "tentacle", 2026-02-21T12:11:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "allow_crimson": false, 2026-02-21T12:11:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "pools": [ 2026-02-21T12:11:04.177 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:11:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "pool_name": "test", 2026-02-21T12:11:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "create_time": "2026-02-21T12:10:02.869079+0000", 2026-02-21T12:11:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "flags": 1, 2026-02-21T12:11:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "flags_names": "hashpspool", 2026-02-21T12:11:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "type": 1, 2026-02-21T12:11:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "size": 3, 2026-02-21T12:11:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "min_size": 2, 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "crush_rule": 0, 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_count": 0, 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_target": 0, 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_barrier": 0, 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "is_stretch_pool": false, 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "object_hash": 2, 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "pg_autoscale_mode": "on", 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num": 32, 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num": 1, 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num_target": 32, 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_target": 32, 2026-02-21T12:11:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_pending": 32, 2026-02-21T12:11:04.179 INFO:tasks.workunit.client.0.trial058.stdout: "last_pg_merge_meta": { 2026-02-21T12:11:04.179 INFO:tasks.workunit.client.0.trial058.stdout: "source_pgid": "0.0", 2026-02-21T12:11:04.179 INFO:tasks.workunit.client.0.trial058.stdout: "ready_epoch": 0, 2026-02-21T12:11:04.179 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_started": 0, 2026-02-21T12:11:04.179 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": 0, 2026-02-21T12:11:04.179 INFO:tasks.workunit.client.0.trial058.stdout: "source_version": "0'0", 2026-02-21T12:11:04.179 INFO:tasks.workunit.client.0.trial058.stdout: "target_version": "0'0" 2026-02-21T12:11:04.179 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.179 INFO:tasks.workunit.client.0.trial058.stdout: "last_change": "44", 2026-02-21T12:11:04.179 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend": "0", 2026-02-21T12:11:04.179 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-21T12:11:04.179 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_preluminous": "44", 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "auid": 0, 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "snap_mode": "selfmanaged", 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "snap_seq": 0, 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "snap_epoch": 0, 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "pool_snaps": [], 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps": "[]", 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_bytes": 0, 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_objects": 0, 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "tiers": [], 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "tier_of": -1, 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "read_tier": -1, 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "write_tier": -1, 2026-02-21T12:11:04.180 INFO:tasks.workunit.client.0.trial058.stdout: "cache_mode": "none", 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_bytes": 0, 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_objects": 0, 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_flush_age": 0, 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_evict_age": 0, 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profile": "", 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_params": { 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: "type": "none" 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_period": 0, 2026-02-21T12:11:04.181 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_count": 0, 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "use_gmt_hitset": true, 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "min_read_recency_for_promote": 0, 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "min_write_recency_for_promote": 0, 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_grade_decay_rate": 0, 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_search_last_n": 0, 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "grade_table": [], 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "stripe_width": 0, 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "expected_num_objects": 0, 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "fast_read": false, 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "nonprimary_shards": "{}", 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "options": {}, 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "application_metadata": {}, 2026-02-21T12:11:04.182 INFO:tasks.workunit.client.0.trial058.stdout: "read_balance": { 2026-02-21T12:11:04.183 INFO:tasks.workunit.client.0.trial058.stdout: "score_type": "Fair distribution", 2026-02-21T12:11:04.183 INFO:tasks.workunit.client.0.trial058.stdout: "score_acting": 2.9900000095367432, 2026-02-21T12:11:04.183 INFO:tasks.workunit.client.0.trial058.stdout: "score_stable": 2.9900000095367432, 2026-02-21T12:11:04.183 INFO:tasks.workunit.client.0.trial058.stdout: "optimal_score": 0.67000001668930054, 2026-02-21T12:11:04.183 INFO:tasks.workunit.client.0.trial058.stdout: "raw_score_acting": 2, 2026-02-21T12:11:04.183 INFO:tasks.workunit.client.0.trial058.stdout: "raw_score_stable": 2, 2026-02-21T12:11:04.183 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity_weighted": 1, 2026-02-21T12:11:04.183 INFO:tasks.workunit.client.0.trial058.stdout: "average_primary_affinity": 1, 2026-02-21T12:11:04.183 INFO:tasks.workunit.client.0.trial058.stdout: "average_primary_affinity_weighted": 1 2026-02-21T12:11:04.183 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.183 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.183 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.184 INFO:tasks.workunit.client.0.trial058.stdout: "osds": [ 2026-02-21T12:11:04.184 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.184 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:11:04.184 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "f771bd51-01b5-4958-8546-4ca193c1dcfd", 2026-02-21T12:11:04.184 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:11:04.184 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:11:04.184 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:11:04.184 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:11:04.184 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 5, 2026-02-21T12:11:04.184 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 29, 2026-02-21T12:11:04.184 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 36, 2026-02-21T12:11:04.184 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 44, 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 30, 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6800", 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6801", 2026-02-21T12:11:04.185 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6802", 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:04.186 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6803", 2026-02-21T12:11:04.187 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:04.187 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.187 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.187 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.187 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:11:04.187 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.187 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.187 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.187 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6806", 2026-02-21T12:11:04.187 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:04.187 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.187 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6807", 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6804", 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:04.188 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.189 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.189 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:04.189 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6805", 2026-02-21T12:11:04.189 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:04.189 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.189 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.189 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.189 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6801/3535133695", 2026-02-21T12:11:04.189 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6803/3535133695", 2026-02-21T12:11:04.189 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3535133695", 2026-02-21T12:11:04.189 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3535133695", 2026-02-21T12:11:04.189 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "9144ebf1-e1db-489a-82c1-79c50cc5771e", 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: "up": 0, 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 0, 2026-02-21T12:11:04.190 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 0, 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 9, 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 21, 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 31, 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.191 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.192 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.193 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:04.193 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:11:04.193 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:04.193 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.193 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.193 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.193 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:11:04.193 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.193 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.193 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.193 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:11:04.193 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:04.194 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.194 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.194 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:04.194 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:11:04.194 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:04.194 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.194 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.194 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.194 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:11:04.194 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.194 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.194 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/763868560", 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/763868560", 2026-02-21T12:11:04.195 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/763868560", 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/763868560", 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: "exists" 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "5bdbe793-0c4f-4318-b4c7-a1bb9acfc6fc", 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 13, 2026-02-21T12:11:04.196 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 29, 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 39, 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 0, 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 32, 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:11:04.197 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:04.198 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:04.199 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:04.200 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/2785589244", 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/2785589244", 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2785589244", 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2785589244", 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: "osd_xinfo": [ 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:11:04.201 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:10:27.311273+0000", 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:09:57.000812+0000", 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:10:27.597270+0000", 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:11:04.202 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:10:27.888094+0000", 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:10:01.591328+0000", 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap": [], 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_items": [], 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_primaries": [], 2026-02-21T12:11:04.203 INFO:tasks.workunit.client.0.trial058.stdout: "pg_temp": [], 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "primary_temp": [], 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "blocklist": {}, 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "range_blocklist": {}, 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profiles": { 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "default": { 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "k": "2", 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "m": "2", 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "plugin": "isa", 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "technique": "reed_sol_van" 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps_queue": [], 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "new_removed_snaps": [], 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "new_purged_snaps": [], 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "crush_node_flags": {}, 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "device_class_flags": {}, 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": { 2026-02-21T12:11:04.204 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_enabled": false, 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_bucket_count": 0, 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "degraded_stretch_mode": 0, 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "recovering_stretch_mode": 0, 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_bucket": 0 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "osd_metadata": [ 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6802/3535133695,v1:127.0.0.1:6803/3535133695]", 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:11:04.205 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:11:04.206 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:09:55.184499Z", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6800/3535133695,v1:127.0.0.1:6801/3535133695]", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3535133695,v1:127.0.0.1:6807/3535133695]", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3535133695,v1:127.0.0.1:6805/3535133695]", 2026-02-21T12:11:04.207 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/0", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:11:04.208 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/763868560,v1:127.0.0.1:6813/763868560]", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:11:04.209 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:09:57.101843Z", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/763868560,v1:127.0.0.1:6811/763868560]", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/763868560,v1:127.0.0.1:6817/763868560]", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/763868560,v1:127.0.0.1:6815/763868560]", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:11:04.210 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/1", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/2785589244,v1:127.0.0.1:6813/2785589244]", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:11:04.211 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:11:04.212 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:09:59.711035Z", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/2785589244,v1:127.0.0.1:6811/2785589244]", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2785589244,v1:127.0.0.1:6817/2785589244]", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2785589244,v1:127.0.0.1:6815/2785589244]", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:11:04.213 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/2", 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_clean_epochs": { 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "min_last_epoch_clean": 0, 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": { 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "per_pool": [] 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "osd_epochs": [ 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 36 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.214 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 39 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_first_committed": 1, 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_last_committed": 45, 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "crushmap": { 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "devices": [ 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.0", 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.1", 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.2", 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:11:04.215 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: "types": [ 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 0, 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd" 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: "name": "host" 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 2, 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: "name": "chassis" 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 3, 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: "name": "rack" 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.216 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stderr:report 3630819490 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 4, 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stdout: "name": "row" 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 5, 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pdu" 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 6, 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pod" 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.217 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 7, 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: "name": "room" 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 8, 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: "name": "datacenter" 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 9, 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: "name": "zone" 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 10, 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: "name": "region" 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: "name": "root" 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: "buckets": [ 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.218 INFO:tasks.workunit.client.0.trial058.stdout: "id": -1, 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default", 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "id": -2, 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default~ssd", 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:11:04.219 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058", 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:11:04.220 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058~ssd", 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:11:04.221 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "rules": [ 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "rule_id": 0, 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "rule_name": "replicated_rule", 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "type": 1, 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "steps": [ 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "op": "take", 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "item": -1, 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "item_name": "default" 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "op": "choose_firstn", 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "num": 0, 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: "type": "osd" 2026-02-21T12:11:04.222 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "op": "emit" 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "tunables": { 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_tries": 0, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_fallback_tries": 0, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "choose_total_tries": 50, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_descend_once": 1, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_vary_r": 1, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_stable": 1, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "msr_descents": 100, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "msr_collision_tries": 100, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "straw_calc_version": 1, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "allowed_bucket_algs": 54, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "profile": "jewel", 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "optimal_tunables": 1, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "legacy_tunables": 0, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "minimum_required_version": "jewel", 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables": 1, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables2": 1, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "has_v2_rules": 0, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables3": 1, 2026-02-21T12:11:04.223 INFO:tasks.workunit.client.0.trial058.stdout: "has_v3_rules": 0, 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "has_v4_buckets": 1, 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables5": 1, 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "has_v5_rules": 0, 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "has_msr_rules": 0 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "choose_args": {} 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "fsmap": { 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "btime": "2026-02-21T12:09:54:476605+0000", 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "default_fscid": -1, 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "compat": { 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "compat": {}, 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "ro_compat": {}, 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "incompat": { 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "feature_1": "base v0.20", 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "feature_2": "client writeable ranges", 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "feature_3": "default file layouts on dirs", 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "feature_4": "dir inode in separate object", 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "feature_5": "mds uses versioned encoding", 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "feature_8": "no anchor table", 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "feature_9": "file layout v2", 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "feature_10": "snaprealm v2", 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "feature_11": "minor log segments", 2026-02-21T12:11:04.224 INFO:tasks.workunit.client.0.trial058.stdout: "feature_12": "quiesce subvolumes" 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "feature_flags": { 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "enable_multiple": true, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "ever_enabled_multiple": true 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "standbys": [], 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "filesystems": [] 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_first_committed": 1, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_last_committed": 1, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "auth": { 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 5, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "num_secrets": 3 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 32, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_active": 32, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_unknown": 0, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "num_osd": 3, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "pool_sum": { 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 51200, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 100, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 0, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 300, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:11:04.225 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 100, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 100, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 100, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 100, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:11:04.226 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 512, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 512, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "up": 64, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 64, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 0 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum": { 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 3, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:11:04.227 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 83952, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2168, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 31, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 81696, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314488848, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322036580352, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2220032, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 458713, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 31919, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 83657553 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 0, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.228 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum_by_class": { 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "ssd": { 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 3, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 83952, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2168, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 31, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 81696, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314488848, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322036580352, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2220032, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 458713, 2026-02-21T12:11:04.229 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 31919, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 83657553 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 0, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "pool_stats": [ 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": 1, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 32, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 51200, 2026-02-21T12:11:04.230 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 100, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 300, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 100, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 100, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 100, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 100, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:11:04.231 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 1220608, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 153552, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 512, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 512, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "up": 64, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 64, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 3 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "osd_stats": [ 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:11:04.232 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 154618822665 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 38654705676 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 167503724553 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_state": [ 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "state": "active+undersized+degraded", 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "num": 31 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "state": "active+undersized+degraded+wait", 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "num": 1 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "pool_pg_unavailable_map": [ 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": "1", 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "pgs": [] 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_osd": [ 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 32, 2026-02-21T12:11:04.233 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 32, 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 32, 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 0, 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": [ 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": {} 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "servicemap": { 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 3, 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:11:00.702174+0000", 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "services": { 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "osd": { 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "daemons": { 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "summary": "", 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "0": { 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "start_epoch": 0, 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "start_stamp": "0.000000", 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "gid": 0, 2026-02-21T12:11:04.234 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "metadata": {}, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "task_status": {} 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "2": { 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "start_epoch": 0, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "start_stamp": "0.000000", 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "gid": 0, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "metadata": {}, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "task_status": {} 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_first_committed": 1, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_last_committed": 35, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "logm_first_committed": 1, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "logm_last_committed": 221, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "paxos": { 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 308, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "last_pn": 0, 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: "accepted_pn": 0 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:04.235 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:11:04.236 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-21T12:11:04.236 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: expr 2 + 2 2026-02-21T12:11:04.236 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: objname=existing_4 2026-02-21T12:11:04.236 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:756: TEST_divergent_3: echo 'writing non-divergent object existing_4' 2026-02-21T12:11:04.236 INFO:tasks.workunit.client.0.trial058.stdout:writing non-divergent object existing_4 2026-02-21T12:11:04.236 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:757: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:11:04.388 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864201+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864262+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864051+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865264+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863741+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864282+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863922+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865374+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865395+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864475+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865858+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865293+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864337+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864428+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864555+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863792+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded+wait 2026-02-21T12:10:58.861923+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865254+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865318+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865372+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862535+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863973+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863459+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863914+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864371+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863474+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863944+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864000+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862367+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863379+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862521+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863768+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:11:04.389 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:11:04.390 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:11:04.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.kweN47FVqk 2026-02-21T12:11:04.415 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-21T12:11:04.415 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: wait_for_clean 2026-02-21T12:11:04.415 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:11:04.415 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:11:04.415 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:11:04.416 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-21T12:11:04.416 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:11:04.416 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:11:04.416 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:11:04.416 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:11:04.416 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:11:04.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-21T12:11:04.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:11:04.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:11:04.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:11:04.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:11:04.471 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:11:04.699 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:11:04.699 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:11:04.699 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:11:04.699 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:11:04.699 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:11:04.699 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:11:04.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=154618822668 2026-02-21T12:11:04.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 154618822668 2026-02-21T12:11:04.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-154618822668' 2026-02-21T12:11:04.766 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:11:04.766 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:11:04.816 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq= 2026-02-21T12:11:04.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: true 2026-02-21T12:11:04.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z '' 2026-02-21T12:11:04.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2289: flush_pg_stats: continue 2026-02-21T12:11:04.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:11:04.817 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:11:04.885 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=167503724555 2026-02-21T12:11:04.885 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 167503724555 2026-02-21T12:11:04.885 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-154618822668 2-167503724555' 2026-02-21T12:11:04.885 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:11:04.885 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-154618822668 2026-02-21T12:11:04.885 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:11:04.886 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:11:04.887 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-154618822668 2026-02-21T12:11:04.887 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:11:04.888 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=154618822668 2026-02-21T12:11:04.888 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 154618822668' 2026-02-21T12:11:04.888 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 154618822668 2026-02-21T12:11:04.888 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:11:05.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 154618822666 -lt 154618822668 2026-02-21T12:11:05.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:11:06.118 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:11:06.119 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:11:06.350 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 154618822666 -lt 154618822668 2026-02-21T12:11:06.350 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:11:07.351 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-21T12:11:07.351 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:11:07.582 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 154618822668 -lt 154618822668 2026-02-21T12:11:07.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:11:07.583 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-167503724555 2026-02-21T12:11:07.583 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:11:07.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:11:07.584 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-167503724555 2026-02-21T12:11:07.584 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:11:07.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=167503724555 2026-02-21T12:11:07.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 167503724555' 2026-02-21T12:11:07.586 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 167503724555 2026-02-21T12:11:07.586 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:11:07.816 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 167503724556 -lt 167503724555 2026-02-21T12:11:07.816 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:11:07.817 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:11:07.817 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:11:08.139 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-21T12:11:08.139 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:11:08.139 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:11:08.140 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:11:08.140 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:11:08.140 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:11:08.140 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:11:08.140 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:11:08.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:11:08.368 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:11:08.368 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:11:08.368 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:11:08.700 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-21T12:11:08.700 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-21T12:11:08.700 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-21T12:11:08.700 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-21T12:11:08.700 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:11:08.701 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-21T12:11:08.800 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:11:08.801 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:11:08.801 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:11:08.801 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:11:08.801 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:11:08.801 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:11:08.801 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:11:08.801 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:11:09.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:11:09.036 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:11:09.036 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:11:09.036 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:11:09.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-21T12:11:09.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:11:09.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:11:09.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:11:09.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:11:09.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:11:09.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:11:09.360 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:11:09.360 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:11:09.675 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:11:09.676 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:11:09.676 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-21T12:11:09.676 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:11:09.676 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-21T12:11:09.876 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:11:09.877 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:11:09.877 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:11:09.878 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:11:09.878 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:11:09.878 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:11:09.878 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:11:09.878 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:11:10.105 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:11:10.105 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:11:10.105 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:11:10.105 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:11:10.428 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-21T12:11:10.428 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:11:10.428 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:11:10.428 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:11:10.428 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:11:10.428 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:11:10.428 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:11:10.428 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:11:10.429 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:11:10.745 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:11:10.745 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:11:10.745 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-21T12:11:10.745 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:11:10.745 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-21T12:11:11.147 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:11:11.148 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:11:11.148 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:11:11.148 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:11:11.148 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:11:11.148 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:11:11.149 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:11:11.149 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:11:11.376 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:11:11.377 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:11:11.377 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:11:11.377 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:11:11.696 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-21T12:11:11.697 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:11:11.697 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:11:11.697 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:11:11.697 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:11:11.697 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:11:11.697 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:11:11.697 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:11:11.697 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:11:12.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:11:12.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:11:12.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-21T12:11:12.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:11:12.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-21T12:11:12.810 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:11:12.810 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:11:12.810 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:11:12.810 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:11:12.810 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:11:12.810 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:11:12.811 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:11:12.811 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:11:13.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:11:13.041 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:11:13.042 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:11:13.042 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:11:13.363 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-21T12:11:13.363 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:11:13.363 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:11:13.363 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:11:13.364 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:11:13.364 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:11:13.364 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:11:13.364 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:11:13.364 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:11:13.682 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:11:13.682 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:11:13.682 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-21T12:11:13.683 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:11:13.683 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-21T12:11:15.283 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:11:15.283 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:11:15.284 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:11:15.284 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:11:15.284 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:11:15.284 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:11:15.284 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:11:15.284 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:11:15.512 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:11:15.512 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:11:15.513 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:11:15.513 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:11:15.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-21T12:11:15.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:11:15.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:11:15.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:11:15.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:11:15.827 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:11:15.827 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:11:15.827 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:11:15.827 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:11:16.140 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:11:16.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:11:16.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-21T12:11:16.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:11:16.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-21T12:11:19.341 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:11:19.341 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:11:19.341 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:11:19.341 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:11:19.341 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:11:19.341 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:11:19.342 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:11:19.342 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:11:19.571 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:11:19.571 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:11:19.571 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:11:19.571 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:11:19.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-21T12:11:19.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:11:19.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:11:19.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:11:19.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:11:19.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:11:19.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:11:19.887 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:11:19.888 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:11:20.203 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:11:20.203 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:11:20.203 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-21T12:11:20.203 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:11:20.203 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-21T12:11:26.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:11:26.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:11:26.605 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:11:26.606 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:11:26.606 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:11:26.606 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:11:26.606 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:11:26.606 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:11:26.834 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:11:26.835 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:11:26.835 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:11:26.836 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:11:27.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-21T12:11:27.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:11:27.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:11:27.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:11:27.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:11:27.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:11:27.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:11:27.155 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:11:27.155 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:11:27.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:11:27.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:11:27.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-21T12:11:27.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:11:27.471 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-21T12:11:34.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:11:34.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:11:34.772 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:11:34.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:11:34.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:11:34.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:11:34.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:11:34.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:11:34.997 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:11:34.998 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:11:34.998 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:11:34.998 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:11:35.314 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-21T12:11:35.314 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:11:35.314 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:11:35.314 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:11:35.314 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:11:35.314 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:11:35.314 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:11:35.314 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:11:35.315 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:11:35.628 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:11:35.629 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:11:35.629 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-21T12:11:35.629 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-21T12:11:35.937 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_fingerprint": "abd1f11e-8cb1-44fa-ae1e-22f8bd855369", 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "version": "20.3.0-5397-gf7273f30", 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "commit": "f7273f3049146bdd7fa7b4a400114872a50228e9", 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "timestamp": "2026-02-21T12:11:35.948956+0000", 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "tag": "", 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "health": { 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "status": "HEALTH_WARN", 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "checks": { 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "OSDMAP_FLAGS": { 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: "count": 17 2026-02-21T12:11:35.938 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.939 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [], 2026-02-21T12:11:35.939 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:11:35.939 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.939 INFO:tasks.workunit.client.0.trial058.stdout: "OSD_DOWN": { 2026-02-21T12:11:35.939 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:11:35.939 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:11:35.939 INFO:tasks.workunit.client.0.trial058.stdout: "message": "1 osds down", 2026-02-21T12:11:35.939 INFO:tasks.workunit.client.0.trial058.stdout: "count": 1 2026-02-21T12:11:35.939 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: "message": "osd.1 (root=default,host=trial058) is down" 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: "PG_DEGRADED": { 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: "count": 32 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.940 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.941 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.942 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.943 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.944 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.944 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.944 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.944 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.944 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.944 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.944 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.944 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.945 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.945 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.945 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.945 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.945 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.945 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.945 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.945 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.945 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.945 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.946 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: "mutes": [] 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_first_committed": 1, 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_last_committed": 1, 2026-02-21T12:11:35.947 INFO:tasks.workunit.client.0.trial058.stdout: "monmap": { 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:09:54.441708Z", 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:09:54.441708Z", 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release": 20, 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "election_strategy": 1, 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "disallowed_leaders": "", 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": false, 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "tiebreaker_mon": "", 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "removed_ranks": "", 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "features": { 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "persistent": [ 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "kraken", 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "luminous", 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "mimic", 2026-02-21T12:11:35.948 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap-prune", 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "nautilus", 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "octopus", 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "pacific", 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "elector-pinging", 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "quincy", 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "reef", 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "squid", 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "tentacle", 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "nvmeof_beacon_diff" 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "optional": [] 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "mons": [ 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "rank": 0, 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "name": "a", 2026-02-21T12:11:35.949 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115", 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 0 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115/0", 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: "priority": 0, 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 0, 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: "time_added": "2026-02-21T12:09:54:441704+0000", 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: "crush_location": [] 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.950 INFO:tasks.workunit.client.0.trial058.stdout: "quorum": [ 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: 0 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap": { 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 45, 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:09:54.476791+0000", 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:10:58.853579+0000", 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "last_up_change": "2026-02-21T12:10:31.086587+0000", 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "last_in_change": "2026-02-21T12:10:32.632502+0000", 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "flags_num": 5800384, 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "flags_set": [ 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "nodown", 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "noin", 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "noout", 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "pglog_hardlimit", 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snapdirs", 2026-02-21T12:11:35.951 INFO:tasks.workunit.client.0.trial058.stdout: "recovery_deletes", 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "sortbitwise" 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "crush_version": 9, 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "full_ratio": 0.99000000953674316, 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_snapshot": "", 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "pool_max": 1, 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "max_osd": 3, 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "require_min_compat_client": "luminous", 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "min_compat_client": "jewel", 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "require_osd_release": "tentacle", 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "allow_crimson": false, 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "pools": [ 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:11:35.952 INFO:tasks.workunit.client.0.trial058.stdout: "pool_name": "test", 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "create_time": "2026-02-21T12:10:02.869079+0000", 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "flags": 1, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "flags_names": "hashpspool", 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "type": 1, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "size": 3, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "min_size": 2, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "crush_rule": 0, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_count": 0, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_target": 0, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_barrier": 0, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "is_stretch_pool": false, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "object_hash": 2, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "pg_autoscale_mode": "on", 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num": 32, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num": 1, 2026-02-21T12:11:35.953 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num_target": 32, 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_target": 32, 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_pending": 32, 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "last_pg_merge_meta": { 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "source_pgid": "0.0", 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "ready_epoch": 0, 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_started": 0, 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": 0, 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "source_version": "0'0", 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "target_version": "0'0" 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "last_change": "44", 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend": "0", 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_preluminous": "44", 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "auid": 0, 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "snap_mode": "selfmanaged", 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "snap_seq": 0, 2026-02-21T12:11:35.954 INFO:tasks.workunit.client.0.trial058.stdout: "snap_epoch": 0, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "pool_snaps": [], 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps": "[]", 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_bytes": 0, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_objects": 0, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "tiers": [], 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "tier_of": -1, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "read_tier": -1, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "write_tier": -1, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "cache_mode": "none", 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_bytes": 0, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_objects": 0, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_flush_age": 0, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_evict_age": 0, 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profile": "", 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_params": { 2026-02-21T12:11:35.955 INFO:tasks.workunit.client.0.trial058.stdout: "type": "none" 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_period": 0, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_count": 0, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "use_gmt_hitset": true, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "min_read_recency_for_promote": 0, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "min_write_recency_for_promote": 0, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_grade_decay_rate": 0, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_search_last_n": 0, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "grade_table": [], 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "stripe_width": 0, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "expected_num_objects": 0, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "fast_read": false, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "nonprimary_shards": "{}", 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "options": {}, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "application_metadata": {}, 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "read_balance": { 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "score_type": "Fair distribution", 2026-02-21T12:11:35.956 INFO:tasks.workunit.client.0.trial058.stdout: "score_acting": 2.9900000095367432, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "score_stable": 2.9900000095367432, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "optimal_score": 0.67000001668930054, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "raw_score_acting": 2, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "raw_score_stable": 2, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity_weighted": 1, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "average_primary_affinity": 1, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "average_primary_affinity_weighted": 1 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "osds": [ 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "f771bd51-01b5-4958-8546-4ca193c1dcfd", 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 5, 2026-02-21T12:11:35.957 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 29, 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 36, 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 44, 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 30, 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6800", 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6801", 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.958 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6802", 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6803", 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6806", 2026-02-21T12:11:35.959 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6807", 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6804", 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6805", 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3535133695 2026-02-21T12:11:35.960 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6801/3535133695", 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6803/3535133695", 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3535133695", 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3535133695", 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "9144ebf1-e1db-489a-82c1-79c50cc5771e", 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "up": 0, 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 0, 2026-02-21T12:11:35.961 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 0, 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 9, 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 21, 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 31, 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:11:35.962 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.963 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 763868560 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.964 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/763868560", 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/763868560", 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/763868560", 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/763868560", 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "exists" 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "5bdbe793-0c4f-4318-b4c7-a1bb9acfc6fc", 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 13, 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 29, 2026-02-21T12:11:35.965 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 39, 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 0, 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 32, 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.966 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.967 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2785589244 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.968 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/2785589244", 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/2785589244", 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2785589244", 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2785589244", 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "osd_xinfo": [ 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:10:27.311273+0000", 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:09:57.000812+0000", 2026-02-21T12:11:35.969 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:10:27.597270+0000", 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:10:27.888094+0000", 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:11:35.970 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:10:01.591328+0000", 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap": [], 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_items": [], 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_primaries": [], 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "pg_temp": [], 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "primary_temp": [], 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "blocklist": {}, 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "range_blocklist": {}, 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profiles": { 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "default": { 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "k": "2", 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "m": "2", 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "plugin": "isa", 2026-02-21T12:11:35.971 INFO:tasks.workunit.client.0.trial058.stdout: "technique": "reed_sol_van" 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps_queue": [], 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "new_removed_snaps": [], 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "new_purged_snaps": [], 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "crush_node_flags": {}, 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "device_class_flags": {}, 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": { 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_enabled": false, 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_bucket_count": 0, 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "degraded_stretch_mode": 0, 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "recovering_stretch_mode": 0, 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_bucket": 0 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "osd_metadata": [ 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.972 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6802/3535133695,v1:127.0.0.1:6803/3535133695]", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:11:35.973 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:09:55.184499Z", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6800/3535133695,v1:127.0.0.1:6801/3535133695]", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3535133695,v1:127.0.0.1:6807/3535133695]", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3535133695,v1:127.0.0.1:6805/3535133695]", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:11:35.974 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/0", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/763868560,v1:127.0.0.1:6813/763868560]", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:11:35.975 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:09:57.101843Z", 2026-02-21T12:11:35.976 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/763868560,v1:127.0.0.1:6811/763868560]", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/763868560,v1:127.0.0.1:6817/763868560]", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/763868560,v1:127.0.0.1:6815/763868560]", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/1", 2026-02-21T12:11:35.977 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/2785589244,v1:127.0.0.1:6813/2785589244]", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:11:35.978 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:09:59.711035Z", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/2785589244,v1:127.0.0.1:6811/2785589244]", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2785589244,v1:127.0.0.1:6817/2785589244]", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2785589244,v1:127.0.0.1:6815/2785589244]", 2026-02-21T12:11:35.979 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/2", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_clean_epochs": { 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "min_last_epoch_clean": 0, 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": { 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "per_pool": [] 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "osd_epochs": [ 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:11:35.980 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 36 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 39 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_first_committed": 1, 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_last_committed": 45, 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "crushmap": { 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "devices": [ 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.0", 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.1", 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.2", 2026-02-21T12:11:35.981 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: "types": [ 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 0, 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd" 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: "name": "host" 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 2, 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: "name": "chassis" 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 3, 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: "name": "rack" 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 4, 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: "name": "row" 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.982 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 5, 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pdu" 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 6, 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pod" 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 7, 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: "name": "room" 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 8, 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: "name": "datacenter" 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 9, 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: "name": "zone" 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 10, 2026-02-21T12:11:35.983 INFO:tasks.workunit.client.0.trial058.stdout: "name": "region" 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "name": "root" 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "buckets": [ 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "id": -1, 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default", 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "id": -2, 2026-02-21T12:11:35.984 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default~ssd", 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058", 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:11:35.985 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.986 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058~ssd", 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "rules": [ 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "rule_id": 0, 2026-02-21T12:11:35.987 INFO:tasks.workunit.client.0.trial058.stdout: "rule_name": "replicated_rule", 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "type": 1, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "steps": [ 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "op": "take", 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "item": -1, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "item_name": "default" 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "op": "choose_firstn", 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "num": 0, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "type": "osd" 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "op": "emit" 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "tunables": { 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_tries": 0, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_fallback_tries": 0, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "choose_total_tries": 50, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_descend_once": 1, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_vary_r": 1, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_stable": 1, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "msr_descents": 100, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "msr_collision_tries": 100, 2026-02-21T12:11:35.988 INFO:tasks.workunit.client.0.trial058.stdout: "straw_calc_version": 1, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "allowed_bucket_algs": 54, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "profile": "jewel", 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "optimal_tunables": 1, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "legacy_tunables": 0, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "minimum_required_version": "jewel", 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables": 1, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables2": 1, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "has_v2_rules": 0, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables3": 1, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "has_v3_rules": 0, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "has_v4_buckets": 1, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables5": 1, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "has_v5_rules": 0, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "has_msr_rules": 0 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "choose_args": {} 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "fsmap": { 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "btime": "2026-02-21T12:09:54:476605+0000", 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "default_fscid": -1, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "compat": { 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "compat": {}, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "ro_compat": {}, 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "incompat": { 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "feature_1": "base v0.20", 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "feature_2": "client writeable ranges", 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "feature_3": "default file layouts on dirs", 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "feature_4": "dir inode in separate object", 2026-02-21T12:11:35.989 INFO:tasks.workunit.client.0.trial058.stdout: "feature_5": "mds uses versioned encoding", 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "feature_8": "no anchor table", 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "feature_9": "file layout v2", 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "feature_10": "snaprealm v2", 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "feature_11": "minor log segments", 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "feature_12": "quiesce subvolumes" 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "feature_flags": { 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "enable_multiple": true, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "ever_enabled_multiple": true 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "standbys": [], 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "filesystems": [] 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_first_committed": 1, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_last_committed": 1, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "auth": { 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 5, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "num_secrets": 3 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 32, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_active": 32, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_unknown": 0, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "num_osd": 3, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "pool_sum": { 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 51688, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 100, 2026-02-21T12:11:35.990 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 300, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 100, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 100, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 101, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 101, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:11:35.991 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 513, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 513, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "up": 64, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 64, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 0 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum": { 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 65, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:11:35.992 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 83952, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2168, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 31, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 81696, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314488848, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322036580352, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2220032, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 459689, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 31919, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 83657553 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 0, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:11:35.993 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum_by_class": { 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "ssd": { 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 65, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 83952, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2168, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 31, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 81696, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314488848, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322036580352, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2220032, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 459689, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 31919, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 83657553 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:11:35.994 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "pool_stats": [ 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": 1, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 32, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 51688, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 100, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 300, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 100, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 100, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:11:35.995 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 101, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 101, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 1220608, 2026-02-21T12:11:35.996 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 154528, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 513, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 513, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "up": 64, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 64, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 3 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "osd_stats": [ 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 154618822674 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 38654705676 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.997 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 167503724561 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_state": [ 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "state": "active+undersized+degraded", 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "num": 32 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "pool_pg_unavailable_map": [ 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": "1", 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "pgs": [] 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_osd": [ 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 32, 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 32, 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 32, 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 0, 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:11:35.998 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": [ 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": {} 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "servicemap": { 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 5, 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:11:32.707611+0000", 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "services": {} 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_first_committed": 1, 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_last_committed": 51, 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "logm_first_committed": 1, 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "logm_last_committed": 280, 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "paxos": { 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 383, 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "last_pn": 0, 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: "accepted_pn": 0 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:11:35.999 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:11:36.000 INFO:tasks.workunit.client.0.trial058.stderr:report 2646158331 2026-02-21T12:11:36.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-21T12:11:36.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:763: TEST_divergent_3: echo 'delay recovery' 2026-02-21T12:11:36.000 INFO:tasks.workunit.client.0.trial058.stdout:delay recovery 2026-02-21T12:11:36.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:764: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864201+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864262+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864051+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865264+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863741+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864282+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863922+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865374+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865395+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864475+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865858+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865293+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864337+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.163 INFO:tasks.workunit.client.0.trial058.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864428+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864555+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863792+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:11:12.739282+0000 29'100 45:150 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:11:59.162880+0000 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865254+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:10:58.865318+0000 45'101 45:150 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865372+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862535+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863973+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863459+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863914+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864371+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863474+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863944+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864000+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862367+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863379+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862521+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863768+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:11:36.164 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:11:36.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-21T12:11:36.171 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.0 2026-02-21T12:11:36.171 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-21T12:11:36.171 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-21T12:11:36.171 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:11:36.171 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:11:36.171 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:11:36.172 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.0.asok 2026-02-21T12:11:36.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-21T12:11:36.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.0.asok set_recovery_delay 100000 2026-02-21T12:11:36.217 INFO:tasks.workunit.client.0.trial058.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-21T12:11:36.221 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-21T12:11:36.222 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.2 2026-02-21T12:11:36.222 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-21T12:11:36.222 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-21T12:11:36.223 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:11:36.223 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:11:36.223 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:11:36.223 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.2.asok 2026-02-21T12:11:36.223 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-21T12:11:36.223 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.2.asok set_recovery_delay 100000 2026-02-21T12:11:36.267 INFO:tasks.workunit.client.0.trial058.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-21T12:11:36.271 INFO:tasks.workunit.client.0.trial058.stdout:revive divergent 1 2026-02-21T12:11:36.272 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:771: TEST_divergent_3: echo 'revive divergent 1' 2026-02-21T12:11:36.272 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:772: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:11:36.487 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:11:36.487 INFO:tasks.workunit.client.0.trial058.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864201+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.487 INFO:tasks.workunit.client.0.trial058.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864262+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.487 INFO:tasks.workunit.client.0.trial058.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864051+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.488 INFO:tasks.workunit.client.0.trial058.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865264+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.488 INFO:tasks.workunit.client.0.trial058.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863741+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.488 INFO:tasks.workunit.client.0.trial058.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864282+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.488 INFO:tasks.workunit.client.0.trial058.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863922+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.488 INFO:tasks.workunit.client.0.trial058.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865374+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.488 INFO:tasks.workunit.client.0.trial058.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865395+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.488 INFO:tasks.workunit.client.0.trial058.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864475+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.488 INFO:tasks.workunit.client.0.trial058.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865858+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.488 INFO:tasks.workunit.client.0.trial058.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865293+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.488 INFO:tasks.workunit.client.0.trial058.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864337+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.488 INFO:tasks.workunit.client.0.trial058.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864428+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.489 INFO:tasks.workunit.client.0.trial058.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864555+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.489 INFO:tasks.workunit.client.0.trial058.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863792+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.489 INFO:tasks.workunit.client.0.trial058.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:11:12.739282+0000 29'100 45:150 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:11:59.162880+0000 0 0 2026-02-21T12:11:36.489 INFO:tasks.workunit.client.0.trial058.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865254+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.489 INFO:tasks.workunit.client.0.trial058.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:10:58.865318+0000 45'101 45:150 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.489 INFO:tasks.workunit.client.0.trial058.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865372+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.489 INFO:tasks.workunit.client.0.trial058.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862535+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.489 INFO:tasks.workunit.client.0.trial058.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863973+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.489 INFO:tasks.workunit.client.0.trial058.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863459+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.489 INFO:tasks.workunit.client.0.trial058.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863914+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.489 INFO:tasks.workunit.client.0.trial058.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864371+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.490 INFO:tasks.workunit.client.0.trial058.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863474+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.490 INFO:tasks.workunit.client.0.trial058.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863944+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.490 INFO:tasks.workunit.client.0.trial058.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864000+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.490 INFO:tasks.workunit.client.0.trial058.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862367+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.490 INFO:tasks.workunit.client.0.trial058.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863379+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.490 INFO:tasks.workunit.client.0.trial058.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862521+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.490 INFO:tasks.workunit.client.0.trial058.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863768+0000 29'100 45:149 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:36.490 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:11:36.490 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:11:36.491 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:11:36.493 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:773: TEST_divergent_3: ceph osd set noup 2026-02-21T12:11:36.847 INFO:tasks.workunit.client.0.trial058.stderr:noup is set 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:774: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:11:36.860 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:11:36.861 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-21T12:11:36.862 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-21T12:11:36.862 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:11:36.862 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:11:36.862 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-21T12:11:36.863 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-21T12:11:36.863 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:11:36.863 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:11:36.863 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:11:36.880 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:11:36.892+0000 7fad8ea42780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:11:36.881 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:11:36.893+0000 7fad8ea42780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:11:36.883 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:11:36.894+0000 7fad8ea42780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:11:37.013 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:11:37.024+0000 7fad8ea42780 -1 Falling back to public interface 2026-02-21T12:11:37.091 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-21T12:11:37.092 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:775: TEST_divergent_3: sleep 5 2026-02-21T12:11:37.302 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:11:37.313+0000 7fad8ea42780 -1 osd.1 29 log_to_monitors true 2026-02-21T12:11:42.093 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: echo 'delay recovery divergent' 2026-02-21T12:11:42.094 INFO:tasks.workunit.client.0.trial058.stdout:delay recovery divergent 2026-02-21T12:11:42.094 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:778: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:11:42.314 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:11:42.314 INFO:tasks.workunit.client.0.trial058.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864201+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:29.127664+0000 0 0 2026-02-21T12:11:42.314 INFO:tasks.workunit.client.0.trial058.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864262+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:23.057108+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864051+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:21.127307+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865264+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863741+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:17.092582+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864282+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863922+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:19.118974+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865374+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865395+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864475+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865858+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865293+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864337+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:34.147188+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864428+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864555+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863792+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:35.146224+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:11:12.739282+0000 29'100 48:156 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:11:59.162880+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865254+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:10:58.865318+0000 45'101 48:156 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865372+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862535+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:05.119190+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863973+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:31.156916+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863459+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:10.149218+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863914+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:22.104022+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864371+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863474+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:13.083600+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863944+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:24.051177+0000 0 0 2026-02-21T12:11:42.315 INFO:tasks.workunit.client.0.trial058.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864000+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:28.085970+0000 0 0 2026-02-21T12:11:42.316 INFO:tasks.workunit.client.0.trial058.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862367+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:02.107543+0000 0 0 2026-02-21T12:11:42.316 INFO:tasks.workunit.client.0.trial058.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863379+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:09.163449+0000 0 0 2026-02-21T12:11:42.316 INFO:tasks.workunit.client.0.trial058.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862521+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:03.061572+0000 0 0 2026-02-21T12:11:42.316 INFO:tasks.workunit.client.0.trial058.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863768+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:16.116532+0000 0 0 2026-02-21T12:11:42.316 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:11:42.316 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:11:42.316 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:11:42.322 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: get_asok_path osd.1 2026-02-21T12:11:42.322 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-21T12:11:42.322 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-21T12:11:42.322 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:11:42.322 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:11:42.322 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:11:42.322 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.1.asok 2026-02-21T12:11:42.323 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: CEPH_ARGS= 2026-02-21T12:11:42.323 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.1.asok set_recovery_delay 100000 2026-02-21T12:11:42.368 INFO:tasks.workunit.client.0.trial058.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-21T12:11:42.371 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:781: TEST_divergent_3: ceph osd unset noup 2026-02-21T12:11:42.683 INFO:tasks.workunit.client.0.trial058.stderr:noup is unset 2026-02-21T12:11:42.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:783: TEST_divergent_3: wait_for_osd up 0 2026-02-21T12:11:42.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:11:42.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:11:42.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:11:42.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:11:42.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:11:42.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:11:42.695 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:11:42.696 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:11:42.696 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:11:42.928 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 36 up_thru 44 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6800/3535133695,v1:127.0.0.1:6801/3535133695] [v2:127.0.0.1:6802/3535133695,v1:127.0.0.1:6803/3535133695] exists,up f771bd51-01b5-4958-8546-4ca193c1dcfd 2026-02-21T12:11:42.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:11:42.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:11:42.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:11:42.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:784: TEST_divergent_3: wait_for_osd up 1 2026-02-21T12:11:42.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:11:42.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:11:42.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:11:42.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:11:42.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:11:42.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:11:42.931 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:11:42.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:11:42.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:11:43.161 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/1238938655,v1:127.0.0.1:6819/1238938655] [v2:127.0.0.1:6820/1238938655,v1:127.0.0.1:6821/1238938655] exists,up 9144ebf1-e1db-489a-82c1-79c50cc5771e 2026-02-21T12:11:43.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:11:43.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:11:43.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:11:43.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:785: TEST_divergent_3: wait_for_osd up 2 2026-02-21T12:11:43.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:11:43.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:11:43.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:11:43.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:11:43.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:11:43.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:11:43.162 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:11:43.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:11:43.163 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:11:43.389 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 39 up_thru 0 down_at 32 last_clean_interval [13,29) [v2:127.0.0.1:6810/2785589244,v1:127.0.0.1:6811/2785589244] [v2:127.0.0.1:6812/2785589244,v1:127.0.0.1:6813/2785589244] exists,up 5bdbe793-0c4f-4318-b4c7-a1bb9acfc6fc 2026-02-21T12:11:43.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:11:43.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:11:43.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:11:43.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:787: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:11:43.610 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:11:43.610 INFO:tasks.workunit.client.0.trial058.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864201+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:29.127664+0000 0 0 2026-02-21T12:11:43.610 INFO:tasks.workunit.client.0.trial058.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864262+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:23.057108+0000 0 0 2026-02-21T12:11:43.611 INFO:tasks.workunit.client.0.trial058.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864051+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:21.127307+0000 0 0 2026-02-21T12:11:43.611 INFO:tasks.workunit.client.0.trial058.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865264+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.611 INFO:tasks.workunit.client.0.trial058.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863741+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:17.092582+0000 0 0 2026-02-21T12:11:43.611 INFO:tasks.workunit.client.0.trial058.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864282+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.611 INFO:tasks.workunit.client.0.trial058.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863922+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:19.118974+0000 0 0 2026-02-21T12:11:43.612 INFO:tasks.workunit.client.0.trial058.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865374+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.612 INFO:tasks.workunit.client.0.trial058.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865395+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.612 INFO:tasks.workunit.client.0.trial058.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864475+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.612 INFO:tasks.workunit.client.0.trial058.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865858+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.612 INFO:tasks.workunit.client.0.trial058.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865293+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.612 INFO:tasks.workunit.client.0.trial058.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864337+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:34.147188+0000 0 0 2026-02-21T12:11:43.612 INFO:tasks.workunit.client.0.trial058.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864428+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.613 INFO:tasks.workunit.client.0.trial058.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864555+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.613 INFO:tasks.workunit.client.0.trial058.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863792+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:35.146224+0000 0 0 2026-02-21T12:11:43.613 INFO:tasks.workunit.client.0.trial058.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:11:12.739282+0000 29'100 48:156 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:11:59.162880+0000 0 0 2026-02-21T12:11:43.613 INFO:tasks.workunit.client.0.trial058.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865254+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.613 INFO:tasks.workunit.client.0.trial058.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:10:58.865318+0000 45'101 48:156 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.614 INFO:tasks.workunit.client.0.trial058.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865372+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.614 INFO:tasks.workunit.client.0.trial058.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862535+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:05.119190+0000 0 0 2026-02-21T12:11:43.614 INFO:tasks.workunit.client.0.trial058.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863973+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:31.156916+0000 0 0 2026-02-21T12:11:43.614 INFO:tasks.workunit.client.0.trial058.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863459+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:10.149218+0000 0 0 2026-02-21T12:11:43.614 INFO:tasks.workunit.client.0.trial058.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863914+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:22.104022+0000 0 0 2026-02-21T12:11:43.614 INFO:tasks.workunit.client.0.trial058.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864371+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.615 INFO:tasks.workunit.client.0.trial058.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863474+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:13.083600+0000 0 0 2026-02-21T12:11:43.615 INFO:tasks.workunit.client.0.trial058.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863944+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:24.051177+0000 0 0 2026-02-21T12:11:43.615 INFO:tasks.workunit.client.0.trial058.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864000+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:28.085970+0000 0 0 2026-02-21T12:11:43.615 INFO:tasks.workunit.client.0.trial058.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862367+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:02.107543+0000 0 0 2026-02-21T12:11:43.615 INFO:tasks.workunit.client.0.trial058.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863379+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:09.163449+0000 0 0 2026-02-21T12:11:43.615 INFO:tasks.workunit.client.0.trial058.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862521+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:03.061572+0000 0 0 2026-02-21T12:11:43.616 INFO:tasks.workunit.client.0.trial058.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863768+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:16.116532+0000 0 0 2026-02-21T12:11:43.616 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:11:43.616 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:11:43.617 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:11:43.617 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:788: TEST_divergent_3: echo 'wait for peering' 2026-02-21T12:11:43.618 INFO:tasks.workunit.client.0.trial058.stdout:wait for peering 2026-02-21T12:11:43.618 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:789: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:11:43.834 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:11:43.834 INFO:tasks.workunit.client.0.trial058.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864201+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:29.127664+0000 0 0 2026-02-21T12:11:43.834 INFO:tasks.workunit.client.0.trial058.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864262+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:23.057108+0000 0 0 2026-02-21T12:11:43.834 INFO:tasks.workunit.client.0.trial058.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864051+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:21.127307+0000 0 0 2026-02-21T12:11:43.834 INFO:tasks.workunit.client.0.trial058.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865264+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.835 INFO:tasks.workunit.client.0.trial058.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863741+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:17.092582+0000 0 0 2026-02-21T12:11:43.835 INFO:tasks.workunit.client.0.trial058.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864282+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.835 INFO:tasks.workunit.client.0.trial058.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863922+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:19.118974+0000 0 0 2026-02-21T12:11:43.835 INFO:tasks.workunit.client.0.trial058.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865374+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.835 INFO:tasks.workunit.client.0.trial058.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865395+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.835 INFO:tasks.workunit.client.0.trial058.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864475+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.835 INFO:tasks.workunit.client.0.trial058.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865858+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.835 INFO:tasks.workunit.client.0.trial058.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865293+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.835 INFO:tasks.workunit.client.0.trial058.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864337+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:34.147188+0000 0 0 2026-02-21T12:11:43.835 INFO:tasks.workunit.client.0.trial058.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864428+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.835 INFO:tasks.workunit.client.0.trial058.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864555+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.835 INFO:tasks.workunit.client.0.trial058.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863792+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:35.146224+0000 0 0 2026-02-21T12:11:43.836 INFO:tasks.workunit.client.0.trial058.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:11:12.739282+0000 29'100 48:156 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:11:59.162880+0000 0 0 2026-02-21T12:11:43.836 INFO:tasks.workunit.client.0.trial058.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865254+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.836 INFO:tasks.workunit.client.0.trial058.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:10:58.865318+0000 45'101 48:156 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.836 INFO:tasks.workunit.client.0.trial058.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865372+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.836 INFO:tasks.workunit.client.0.trial058.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862535+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:05.119190+0000 0 0 2026-02-21T12:11:43.836 INFO:tasks.workunit.client.0.trial058.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863973+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:31.156916+0000 0 0 2026-02-21T12:11:43.836 INFO:tasks.workunit.client.0.trial058.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863459+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:10.149218+0000 0 0 2026-02-21T12:11:43.836 INFO:tasks.workunit.client.0.trial058.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863914+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:22.104022+0000 0 0 2026-02-21T12:11:43.836 INFO:tasks.workunit.client.0.trial058.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864371+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:43.837 INFO:tasks.workunit.client.0.trial058.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863474+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:13.083600+0000 0 0 2026-02-21T12:11:43.837 INFO:tasks.workunit.client.0.trial058.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863944+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:24.051177+0000 0 0 2026-02-21T12:11:43.837 INFO:tasks.workunit.client.0.trial058.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864000+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:28.085970+0000 0 0 2026-02-21T12:11:43.837 INFO:tasks.workunit.client.0.trial058.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862367+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:02.107543+0000 0 0 2026-02-21T12:11:43.837 INFO:tasks.workunit.client.0.trial058.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863379+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:09.163449+0000 0 0 2026-02-21T12:11:43.837 INFO:tasks.workunit.client.0.trial058.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862521+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:03.061572+0000 0 0 2026-02-21T12:11:43.837 INFO:tasks.workunit.client.0.trial058.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863768+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:16.116532+0000 0 0 2026-02-21T12:11:43.837 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:11:43.837 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:11:43.838 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:11:43.841 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:790: TEST_divergent_3: rados -p test put foo /tmp/tmp.hbE85LUcO4 2026-02-21T12:11:43.862 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:791: TEST_divergent_3: rm -f /tmp/tmp.hbE85LUcO4 2026-02-21T12:11:43.863 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: rm -f /tmp/tmp.kweN47FVqk 2026-02-21T12:11:43.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:796: TEST_divergent_3: echo 'killing divergent 1' 2026-02-21T12:11:43.865 INFO:tasks.workunit.client.0.trial058.stdout:killing divergent 1 2026-02-21T12:11:43.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864201+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:29.127664+0000 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864262+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:23.057108+0000 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864051+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:21.127307+0000 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865264+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863741+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:17.092582+0000 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864282+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863922+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:19.118974+0000 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865374+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865395+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864475+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865858+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865293+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864337+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:34.147188+0000 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864428+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864555+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.092 INFO:tasks.workunit.client.0.trial058.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863792+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:35.146224+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:11:12.739282+0000 29'100 48:156 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:11:59.162880+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865254+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:10:58.865318+0000 45'101 48:156 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865372+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862535+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:05.119190+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863973+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:31.156916+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863459+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:10.149218+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863914+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:22.104022+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864371+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863474+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:13.083600+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863944+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:24.051177+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864000+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:28.085970+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862367+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:02.107543+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863379+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:09.163449+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862521+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:03.061572+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863768+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:16.116532+0000 0 0 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:11:44.093 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:11:44.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:798: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd.1 2026-02-21T12:11:44.099 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:11:44.099 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:11:44.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:11:44.100 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:11:44.100 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:11:44.206 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:11:44.206 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:801: TEST_divergent_3: expfile=td/divergent-priors/exp.43953.out 2026-02-21T12:11:44.206 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:802: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.43953.out 2026-02-21T12:11:44.206 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-21T12:11:44.206 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-21T12:11:44.206 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-21T12:11:44.206 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-21T12:11:44.206 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-21T12:11:44.206 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.43953.out 2026-02-21T12:11:44.308 INFO:tasks.workunit.client.0.trial058.stderr:Exporting 1.0 info 1.0( v 29'100 (29'90,29'100] local-lis/les=50/51 n=3 ec=21/21 lis/c=50/50 les/c/f=51/51/0 sis=50) 2026-02-21T12:11:44.308 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-21T12:11:44.308 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-21T12:11:44.308 INFO:tasks.workunit.client.0.trial058.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-21T12:11:44.308 INFO:tasks.workunit.client.0.trial058.stderr:Export successful 2026-02-21T12:11:44.309 INFO:tasks.workunit.client.0.trial058.stdout: marking collection for removal 2026-02-21T12:11:44.309 INFO:tasks.workunit.client.0.trial058.stdout:setting '_remove' omap key 2026-02-21T12:11:44.309 INFO:tasks.workunit.client.0.trial058.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-21T12:11:44.309 INFO:tasks.workunit.client.0.trial058.stderr:Remove successful 2026-02-21T12:11:44.344 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:803: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.43953.out 2026-02-21T12:11:44.344 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-21T12:11:44.344 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-21T12:11:44.344 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-21T12:11:44.345 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-21T12:11:44.345 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-21T12:11:44.345 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.43953.out 2026-02-21T12:11:44.435 INFO:tasks.workunit.client.0.trial058.stdout:get_pg_num_history pg_num_history pg_num_history(e52 pg_nums {1={21=1,44=32}} deleted_pools ) 2026-02-21T12:11:44.435 INFO:tasks.workunit.client.0.trial058.stdout:Importing pgid 1.0 2026-02-21T12:11:44.435 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-21T12:11:44.436 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:11:44.436 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-21T12:11:44.436 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:11:44.436 INFO:tasks.workunit.client.0.trial058.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-21T12:11:44.436 INFO:tasks.workunit.client.0.trial058.stdout:snapset 0={} 2026-02-21T12:11:44.436 INFO:tasks.workunit.client.0.trial058.stdout:write_pg epoch 51 info 1.0( v 29'100 (29'90,29'100] local-lis/les=50/51 n=3 ec=21/21 lis/c=50/50 les/c/f=51/51/0 sis=50) 2026-02-21T12:11:44.436 INFO:tasks.workunit.client.0.trial058.stdout:Import successful 2026-02-21T12:11:44.485 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:805: TEST_divergent_3: echo 'reviving divergent 1' 2026-02-21T12:11:44.485 INFO:tasks.workunit.client.0.trial058.stdout:reviving divergent 1 2026-02-21T12:11:44.486 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:11:44.702 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864201+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:29.127664+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864262+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:23.057108+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864051+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:21.127307+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865264+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863741+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:17.092582+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864282+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863922+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:19.118974+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865374+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865395+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864475+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865858+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865293+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864337+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:34.147188+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864428+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864555+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863792+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:35.146224+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:11:12.739282+0000 29'100 48:156 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:11:59.162880+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865254+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-21T12:10:58.865318+0000 45'101 48:156 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.865372+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862535+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:05.119190+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863973+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:31.156916+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863459+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:10.149218+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863914+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:22.104022+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864371+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863474+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:13.083600+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863944+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:24.051177+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.864000+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:28.085970+0000 0 0 2026-02-21T12:11:44.703 INFO:tasks.workunit.client.0.trial058.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862367+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:02.107543+0000 0 0 2026-02-21T12:11:44.704 INFO:tasks.workunit.client.0.trial058.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863379+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:09.163449+0000 0 0 2026-02-21T12:11:44.704 INFO:tasks.workunit.client.0.trial058.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.862521+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:03.061572+0000 0 0 2026-02-21T12:11:44.704 INFO:tasks.workunit.client.0.trial058.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:10:58.863768+0000 29'100 48:155 [0,2] 0 [0,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 user requested scrub scheduled @ 2026-02-21T12:12:16.116532+0000 0 0 2026-02-21T12:11:44.704 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:11:44.704 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:11:44.704 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:11:44.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-21T12:11:44.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:11:44.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:11:44.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-21T12:11:44.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:11:44.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-21T12:11:44.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:11:44.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:11:44.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:11:44.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:11:44.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-21T12:11:44.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-21T12:11:44.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:11:44.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:11:44.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:11:44.711 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:11:44.711 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:11:44.711 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:11:44.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-21T12:11:44.713 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-21T12:11:44.713 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:11:44.713 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:11:44.713 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-21T12:11:44.713 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-21T12:11:44.713 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:11:44.714 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:11:44.714 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:11:44.730 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:11:44.741+0000 7efe4f019780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:11:44.731 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:11:44.743+0000 7efe4f019780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:11:44.732 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:11:44.744+0000 7efe4f019780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:11:44.864 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:11:44.875+0000 7efe4f019780 -1 Falling back to public interface 2026-02-21T12:11:44.941 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-21T12:11:44.942 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:11:44.942 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:11:44.942 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:11:44.942 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:11:44.942 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:11:44.942 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:11:44.942 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:11:44.943 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:11:44.943 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:11:45.160 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:11:45.171+0000 7efe4f019780 -1 osd.1 52 log_to_monitors true 2026-02-21T12:11:45.175 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/1238938655,v1:127.0.0.1:6819/1238938655] [v2:127.0.0.1:6820/1238938655,v1:127.0.0.1:6821/1238938655] exists,up 9144ebf1-e1db-489a-82c1-79c50cc5771e 2026-02-21T12:11:45.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:11:45.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:11:45.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:11:45.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: wait_for_osd up 1 2026-02-21T12:11:45.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:11:45.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:11:45.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:11:45.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:11:45.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:11:45.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:11:45.178 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:11:45.178 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:11:45.178 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:11:45.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:11:46.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:11:46.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:11:46.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:11:46.409 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:11:46.410 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:11:46.410 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:11:46.637 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 54 last_clean_interval [50,52) [v2:127.0.0.1:6818/2549542823,v1:127.0.0.1:6819/2549542823] [v2:127.0.0.1:6820/2549542823,v1:127.0.0.1:6821/2549542823] exists,up 9144ebf1-e1db-489a-82c1-79c50cc5771e 2026-02-21T12:11:46.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:11:46.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:11:46.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:11:46.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: sleep 20 2026-02-21T12:12:06.640 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: get_asok_path osd.1 2026-02-21T12:12:06.640 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-21T12:12:06.640 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-21T12:12:06.641 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:12:06.641 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:06.642 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:06.642 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.1.asok 2026-02-21T12:12:06.642 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: CEPH_ARGS= 2026-02-21T12:12:06.642 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.1.asok dump_ops_in_flight 2026-02-21T12:12:06.685 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:12:06.686 INFO:tasks.workunit.client.0.trial058.stdout: "ops": [], 2026-02-21T12:12:06.686 INFO:tasks.workunit.client.0.trial058.stdout: "num_ops": 0 2026-02-21T12:12:06.686 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:12:06.690 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:813: TEST_divergent_3: echo 'allowing recovery' 2026-02-21T12:12:06.690 INFO:tasks.workunit.client.0.trial058.stdout:allowing recovery 2026-02-21T12:12:06.690 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:12:06.909 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:12:06.909 INFO:tasks.workunit.client.0.trial058.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:11:54.868416+0000 29'100 69:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.909 INFO:tasks.workunit.client.0.trial058.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:12:00.869247+0000 29'100 69:185 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.909 INFO:tasks.workunit.client.0.trial058.stdout:1.1d 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-21T12:11:51.006808+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:51.006780+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T17:16:25.490749+0000 4 0 2026-02-21T12:12:06.909 INFO:tasks.workunit.client.0.trial058.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:11:54.868385+0000 29'100 69:191 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.910 INFO:tasks.workunit.client.0.trial058.stdout:1.a 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-21T12:12:02.000676+0000 29'100 67:196 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-21T12:12:02.000645+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 periodic scrub scheduled @ 2026-02-22T19:10:27.924187+0000 3 0 2026-02-21T12:12:06.910 INFO:tasks.workunit.client.0.trial058.stdout:1.9 5 0 0 0 0 2560 0 0 16 84 16 active+clean 2026-02-21T12:11:55.977393+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:55.977348+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T15:24:01.589310+0000 5 0 2026-02-21T12:12:06.910 INFO:tasks.workunit.client.0.trial058.stdout:1.8 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:12:04.868105+0000 29'100 69:209 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-21T12:11:52.103583+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.910 INFO:tasks.workunit.client.0.trial058.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:11:54.867599+0000 29'100 69:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.910 INFO:tasks.workunit.client.0.trial058.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-21T12:12:00.869519+0000 52'101 69:185 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.910 INFO:tasks.workunit.client.0.trial058.stdout:1.5 6 0 0 0 0 3072 0 0 16 84 16 active+clean 2026-02-21T12:12:00.032705+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:12:00.032680+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 periodic scrub scheduled @ 2026-02-22T18:13:26.187423+0000 6 0 2026-02-21T12:12:06.910 INFO:tasks.workunit.client.0.trial058.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:11:45.550787+0000 29'100 69:193 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.910 INFO:tasks.workunit.client.0.trial058.stdout:1.3 5 0 0 0 0 2560 0 0 10 90 10 active+clean 2026-02-21T12:12:04.078282+0000 29'100 69:199 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-21T12:12:04.078248+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T13:55:09.454458+0000 5 0 2026-02-21T12:12:06.910 INFO:tasks.workunit.client.0.trial058.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:11:52.867588+0000 29'100 67:188 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.910 INFO:tasks.workunit.client.0.trial058.stdout:1.c 3 0 0 0 0 1536 0 0 14 86 14 active+clean 2026-02-21T12:11:56.136601+0000 29'100 69:202 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-21T12:11:56.136567+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:51:16.644062+0000 3 0 2026-02-21T12:12:06.910 INFO:tasks.workunit.client.0.trial058.stdout:1.1 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-21T12:11:56.996166+0000 29'100 69:175 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:56.996117+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T19:11:43.646680+0000 2 0 2026-02-21T12:12:06.911 INFO:tasks.workunit.client.0.trial058.stdout:1.1c 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-21T12:11:55.119193+0000 29'100 69:201 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-21T12:11:55.119149+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T13:19:01.154706+0000 2 0 2026-02-21T12:12:06.911 INFO:tasks.workunit.client.0.trial058.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-21T12:11:51.134618+0000 29'100 69:202 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-21T12:11:51.134592+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T15:57:11.532818+0000 3 0 2026-02-21T12:12:06.911 INFO:tasks.workunit.client.0.trial058.stdout:1.d 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-21T12:11:58.041057+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:58.041030+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T18:20:05.377484+0000 3 0 2026-02-21T12:12:06.911 INFO:tasks.workunit.client.0.trial058.stdout:1.e 4 0 0 0 0 2536 0 0 14 87 14 active+clean 2026-02-21T12:12:01.083323+0000 45'101 69:194 [1,0,2] 1 [1,0,2] 1 45'101 2026-02-21T12:12:01.083291+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T14:22:05.920743+0000 4 0 2026-02-21T12:12:06.911 INFO:tasks.workunit.client.0.trial058.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:11:54.868257+0000 29'100 69:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.911 INFO:tasks.workunit.client.0.trial058.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-21T12:11:53.114424+0000 29'100 69:202 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-21T12:11:53.114386+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T17:01:39.339745+0000 3 0 2026-02-21T12:12:06.911 INFO:tasks.workunit.client.0.trial058.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-21T12:11:54.019348+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:54.019318+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T21:10:08.729299+0000 3 0 2026-02-21T12:12:06.911 INFO:tasks.workunit.client.0.trial058.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-21T12:11:57.977611+0000 29'100 67:196 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-21T12:11:57.977581+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:49:43.209894+0000 1 0 2026-02-21T12:12:06.911 INFO:tasks.workunit.client.0.trial058.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:11:54.868610+0000 29'100 69:191 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.911 INFO:tasks.workunit.client.0.trial058.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:11:45.552040+0000 29'100 69:194 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.911 INFO:tasks.workunit.client.0.trial058.stdout:1.15 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-21T12:11:52.025296+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:52.025272+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T13:36:02.969212+0000 3 0 2026-02-21T12:12:06.912 INFO:tasks.workunit.client.0.trial058.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:12:00.868631+0000 29'100 69:183 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.912 INFO:tasks.workunit.client.0.trial058.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:11:54.868070+0000 29'100 69:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.912 INFO:tasks.workunit.client.0.trial058.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:12:04.868103+0000 29'100 69:201 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.912 INFO:tasks.workunit.client.0.trial058.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-21T12:11:55.016217+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:55.016181+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T19:20:10.502267+0000 2 0 2026-02-21T12:12:06.912 INFO:tasks.workunit.client.0.trial058.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-21T12:11:55.044491+0000 29'100 67:196 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-21T12:11:55.044454+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T12:52:43.998784+0000 4 0 2026-02-21T12:12:06.912 INFO:tasks.workunit.client.0.trial058.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:11:54.868629+0000 29'100 69:192 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:06.912 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:12:06.912 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:12:06.912 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:12:06.916 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-21T12:12:06.916 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-21T12:12:06.979 INFO:tasks.workunit.client.0.trial058.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-21T12:12:06.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-21T12:12:06.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-21T12:12:07.046 INFO:tasks.workunit.client.0.trial058.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-21T12:12:07.052 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-21T12:12:07.052 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-21T12:12:07.116 INFO:tasks.workunit.client.0.trial058.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-21T12:12:07.121 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: echo 'reading divergent objects' 2026-02-21T12:12:07.121 INFO:tasks.workunit.client.0.trial058.stdout:reading divergent objects 2026-02-21T12:12:07.121 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:822: TEST_divergent_3: ceph pg dump pgs 2026-02-21T12:12:07.339 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:12:07.339 INFO:tasks.workunit.client.0.trial058.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:11:54.868416+0000 29'100 69:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.339 INFO:tasks.workunit.client.0.trial058.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:12:00.869247+0000 29'100 69:185 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.339 INFO:tasks.workunit.client.0.trial058.stdout:1.1d 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-21T12:11:51.006808+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:51.006780+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T17:16:25.490749+0000 4 0 2026-02-21T12:12:07.339 INFO:tasks.workunit.client.0.trial058.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:11:54.868385+0000 29'100 69:191 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.a 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-21T12:12:02.000676+0000 29'100 67:196 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-21T12:12:02.000645+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 periodic scrub scheduled @ 2026-02-22T19:10:27.924187+0000 3 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.9 5 0 0 0 0 2560 0 0 16 84 16 active+clean 2026-02-21T12:11:55.977393+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:55.977348+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T15:24:01.589310+0000 5 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.8 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:12:04.868105+0000 29'100 69:209 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-21T12:11:52.103583+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:11:54.867599+0000 29'100 69:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-21T12:12:00.869519+0000 52'101 69:185 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.5 6 0 0 0 0 3072 0 0 16 84 16 active+clean 2026-02-21T12:12:00.032705+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:12:00.032680+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 periodic scrub scheduled @ 2026-02-22T18:13:26.187423+0000 6 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:11:45.550787+0000 29'100 69:193 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.3 5 0 0 0 0 2560 0 0 10 90 10 active+clean 2026-02-21T12:12:04.078282+0000 29'100 69:199 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-21T12:12:04.078248+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T13:55:09.454458+0000 5 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:11:52.867588+0000 29'100 67:188 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.c 3 0 0 0 0 1536 0 0 14 86 14 active+clean 2026-02-21T12:11:56.136601+0000 29'100 69:202 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-21T12:11:56.136567+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:51:16.644062+0000 3 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.1 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-21T12:11:56.996166+0000 29'100 69:175 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:56.996117+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T19:11:43.646680+0000 2 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.1c 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-21T12:11:55.119193+0000 29'100 69:201 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-21T12:11:55.119149+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T13:19:01.154706+0000 2 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-21T12:11:51.134618+0000 29'100 69:202 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-21T12:11:51.134592+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T15:57:11.532818+0000 3 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.d 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-21T12:11:58.041057+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:58.041030+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T18:20:05.377484+0000 3 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.e 4 0 0 0 0 2536 0 0 14 87 14 active+clean 2026-02-21T12:12:01.083323+0000 45'101 69:194 [1,0,2] 1 [1,0,2] 1 45'101 2026-02-21T12:12:01.083291+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T14:22:05.920743+0000 4 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:11:54.868257+0000 29'100 69:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-21T12:11:53.114424+0000 29'100 69:202 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-21T12:11:53.114386+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T17:01:39.339745+0000 3 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-21T12:11:54.019348+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:54.019318+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T21:10:08.729299+0000 3 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-21T12:11:57.977611+0000 29'100 67:196 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-21T12:11:57.977581+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 periodic scrub scheduled @ 2026-02-22T12:49:43.209894+0000 1 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:11:54.868610+0000 29'100 69:191 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:11:45.552040+0000 29'100 69:194 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.15 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-21T12:11:52.025296+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:52.025272+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T13:36:02.969212+0000 3 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:12:00.868631+0000 29'100 69:183 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-21T12:11:54.868070+0000 29'100 69:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:12:04.868103+0000 29'100 69:201 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-21T12:11:55.016217+0000 29'100 69:176 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-21T12:11:55.016181+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T19:20:10.502267+0000 2 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-21T12:11:55.044491+0000 29'100 67:196 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-21T12:11:55.044454+0000 0'0 2026-02-21T12:10:02.899655+0000 0 1 periodic scrub scheduled @ 2026-02-22T12:52:43.998784+0000 4 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-21T12:11:54.868629+0000 29'100 69:192 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-21T12:10:02.899655+0000 0'0 2026-02-21T12:10:02.899655+0000 0 0 queued for scrub 0 0 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:12:07.340 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:12:07.347 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: expr 2 + 2 2026-02-21T12:12:07.348 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: seq 1 4 2026-02-21T12:12:07.349 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:12:07.349 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_1 td/divergent-priors/existing 2026-02-21T12:12:07.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:12:07.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_2 td/divergent-priors/existing 2026-02-21T12:12:07.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:12:07.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_3 td/divergent-priors/existing 2026-02-21T12:12:07.408 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:12:07.408 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_4 td/divergent-priors/existing 2026-02-21T12:12:07.426 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: seq 1 2 2026-02-21T12:12:07.427 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-21T12:12:07.427 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-21T12:12:07.444 INFO:tasks.workunit.client.0.trial058.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-21T12:12:07.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-21T12:12:07.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-21T12:12:07.461 INFO:tasks.workunit.client.0.trial058.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-21T12:12:07.462 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: rm -f td/divergent-priors/existing 2026-02-21T12:12:07.463 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-21T12:12:07.464 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: grep _merge_object_divergent_entries td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-21T12:12:07.471 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.811+0000 7fad6fb80640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4540.0:1 2026-02-21T12:10:16.751410+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:12:07.471 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.811+0000 7fad6fb80640 20 _merge_object_divergent_entries: keeping 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4540.0:1 2026-02-21T12:10:16.751410+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:12:07.471 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.811+0000 7fad6fb80640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:12:07.471 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.811+0000 7fad6fb80640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 29'2 first_divergent_update: 29'104 last_divergent_update: 29'104 2026-02-21T12:12:07.471 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.811+0000 7fad6fb80640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-21T12:12:07.471 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.811+0000 7fad6fb80640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-21T12:12:07.471 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.811+0000 7fad6fb80640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 29'106 2026-02-21T12:12:07.471 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.811+0000 7fad6fb80640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4540.0:1 2026-02-21T12:10:16.751410+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.811+0000 7fad6fb80640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.811+0000 7fad6fb80640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 29'2 <= info.log_tail 29'89 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6d37b640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4545.0:1 2026-02-21T12:10:16.755176+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6d37b640 20 _merge_object_divergent_entries: keeping 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4545.0:1 2026-02-21T12:10:16.755176+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6d37b640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6d37b640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 29'4 first_divergent_update: 29'106 last_divergent_update: 29'106 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6d37b640 10 _merge_object_divergent_entries: more recent entry found: 45'101 (29'4) modify 1:70b3bf12:::existing_4:head by client.4656.0:1 2026-02-21T12:11:04.425477+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6d37b640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 29'102 (0'0) modify 1:75ac5091:::newobject_2:head by client.4533.0:1 2026-02-21T12:10:16.747534+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6d37b640 20 _merge_object_divergent_entries: keeping 29'102 (0'0) modify 1:75ac5091:::newobject_2:head by client.4533.0:1 2026-02-21T12:10:16.747534+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6d37b640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6d37b640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 29'102 last_divergent_update: 29'102 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6d37b640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6d37b640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6bb78640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4542.0:1 2026-02-21T12:10:16.752549+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6bb78640 20 _merge_object_divergent_entries: keeping 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4542.0:1 2026-02-21T12:10:16.752549+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6bb78640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6bb78640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 29'3 first_divergent_update: 29'105 last_divergent_update: 29'105 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6bb78640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6bb78640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6bb78640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 29'106 2026-02-21T12:12:07.472 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6bb78640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4542.0:1 2026-02-21T12:10:16.752549+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-21T12:12:07.473 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6bb78640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-21T12:12:07.473 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6bb78640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 29'3 <= info.log_tail 29'84 2026-02-21T12:12:07.473 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 29'103 (29'1) modify 1:d858c035:::existing_1:head by client.4538.0:1 2026-02-21T12:10:16.750115+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:12:07.473 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 20 _merge_object_divergent_entries: keeping 29'103 (29'1) modify 1:d858c035:::existing_1:head by client.4538.0:1 2026-02-21T12:10:16.750115+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:12:07.477 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:12:07.477 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 29'1 first_divergent_update: 29'103 last_divergent_update: 29'103 2026-02-21T12:12:07.477 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-21T12:12:07.477 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-21T12:12:07.477 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 29'106 2026-02-21T12:12:07.477 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 29'103 (29'1) modify 1:d858c035:::existing_1:head by client.4538.0:1 2026-02-21T12:10:16.750115+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:12:07.477 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-21T12:12:07.477 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 29'1 <= info.log_tail 29'90 2026-02-21T12:12:07.478 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 29'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4532.0:1 2026-02-21T12:10:16.747335+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-21T12:12:07.478 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 20 _merge_object_divergent_entries: keeping 29'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4532.0:1 2026-02-21T12:10:16.747335+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-21T12:12:07.478 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:12:07.478 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 29'101 last_divergent_update: 29'101 2026-02-21T12:12:07.478 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-21T12:12:07.478 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:11:42.812+0000 7fad6ab76640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-21T12:12:07.478 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-21T12:12:07.478 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-21T12:12:07.484 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-21T12:12:07.485 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-21T12:12:07.491 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:846: TEST_divergent_3: echo success 2026-02-21T12:12:07.492 INFO:tasks.workunit.client.0.trial058.stdout:success 2026-02-21T12:12:07.492 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:848: TEST_divergent_3: rm td/divergent-priors/td/divergent-priors/exp.43953.out 2026-02-21T12:12:07.493 INFO:tasks.workunit.client.0.trial058.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.43953.out': No such file or directory 2026-02-21T12:12:07.493 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:849: TEST_divergent_3: delete_pool test 2026-02-21T12:12:07.493 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-21T12:12:07.493 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-21T12:12:07.765 INFO:tasks.workunit.client.0.trial058.stderr:pool 'test' does not exist 2026-02-21T12:12:07.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:850: TEST_divergent_3: kill_daemons td/divergent-priors 2026-02-21T12:12:07.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:12:07.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:12:07.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:12:07.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:12:07.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:12:13.087 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:12:13.087 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-21T12:12:13.088 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-21T12:12:13.088 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:12:13.088 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-21T12:12:13.088 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:12:13.088 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:12:13.089 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:12:13.089 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:12:13.089 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:12:13.093 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:12:13.094 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:12:13.094 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:12:13.094 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:12:13.095 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:12:13.096 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:12:13.096 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:12:13.096 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:12:13.097 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:12:13.097 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:12:13.097 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:12:13.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:12:13.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:12:13.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-21T12:12:13.120 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:12:13.120 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:13.120 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:13.120 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.43953 2026-02-21T12:12:13.122 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:12:13.122 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:12:13.122 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-21T12:12:13.122 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-21T12:12:13.122 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-21T12:12:13.122 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-21T12:12:13.123 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-21T12:12:13.123 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:12:13.123 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-21T12:12:13.123 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:12:13.123 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:12:13.123 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:12:13.123 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:12:13.123 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:12:13.124 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:12:13.124 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:12:13.124 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:12:13.124 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:12:13.125 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:12:13.125 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:12:13.126 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:12:13.126 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:12:13.126 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:12:13.127 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:12:13.127 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:12:13.128 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:12:13.129 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:12:13.129 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-21T12:12:13.130 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:12:13.130 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:13.130 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:13.130 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.43953 2026-02-21T12:12:13.131 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:12:13.131 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:12:13.131 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-21T12:12:13.132 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-21T12:12:13.132 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:13.132 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:13.132 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.43953 2026-02-21T12:12:13.133 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-21T12:12:13.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-21T12:12:13.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-21T12:12:13.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-21T12:12:13.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_ec td/divergent-priors 2026-02-21T12:12:13.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:227: TEST_divergent_ec: local dir=td/divergent-priors 2026-02-21T12:12:13.135 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: file_with_random_data 2026-02-21T12:12:13.135 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: file_with_random_data: local size_bytes=512 2026-02-21T12:12:13.135 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: mktemp 2026-02-21T12:12:13.136 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: local file=/tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:13.136 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.qfK6uRIW7h bs=512 count=1 2026-02-21T12:12:13.136 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records in 2026-02-21T12:12:13.136 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records out 2026-02-21T12:12:13.136 INFO:tasks.workunit.client.0.trial058.stderr:512 bytes copied, 5.2709e-05 s, 9.7 MB/s 2026-02-21T12:12:13.136 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: file_with_random_data: printf %s /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:13.137 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: local dummyfile=/tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:13.137 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: file_with_random_data 1000 2026-02-21T12:12:13.137 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: file_with_random_data: local size_bytes=1000 2026-02-21T12:12:13.138 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: mktemp 2026-02-21T12:12:13.138 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: file_with_random_data: local file=/tmp/tmp.fQw6YkB5T3 2026-02-21T12:12:13.138 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.fQw6YkB5T3 bs=1000 count=1 2026-02-21T12:12:13.139 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records in 2026-02-21T12:12:13.139 INFO:tasks.workunit.client.0.trial058.stderr:1+0 records out 2026-02-21T12:12:13.139 INFO:tasks.workunit.client.0.trial058.stderr:1000 bytes (1.0 kB) copied, 5.0044e-05 s, 20.0 MB/s 2026-02-21T12:12:13.139 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: file_with_random_data: printf %s /tmp/tmp.fQw6YkB5T3 2026-02-21T12:12:13.139 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: local dummyfile2=/tmp/tmp.fQw6YkB5T3 2026-02-21T12:12:13.139 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:233: TEST_divergent_ec: local num_osds=3 2026-02-21T12:12:13.140 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: expr 3 - 1 2026-02-21T12:12:13.140 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: seq 0 2 2026-02-21T12:12:13.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: local 'osds=0 2026-02-21T12:12:13.142 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:12:13.142 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:12:13.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: run_mon td/divergent-priors a 2026-02-21T12:12:13.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-21T12:12:13.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-21T12:12:13.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-21T12:12:13.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-21T12:12:13.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-21T12:12:13.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-21T12:12:13.163 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-21T12:12:13.163 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:12:13.163 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:12:13.163 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:12:13.163 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:13.163 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:13.163 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:12:13.163 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-21T12:12:13.189 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-21T12:12:13.190 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-21T12:12:13.190 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:12:13.190 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:12:13.190 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-21T12:12:13.190 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-21T12:12:13.191 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:12:13.191 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:12:13.191 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:12:13.191 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:12:13.191 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:13.191 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:13.191 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-mon.a.asok 2026-02-21T12:12:13.191 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:12:13.191 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.43953/ceph-mon.a.asok config get fsid 2026-02-21T12:12:13.235 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-21T12:12:13.235 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:12:13.235 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:12:13.235 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-21T12:12:13.236 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-21T12:12:13.236 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:12:13.236 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:12:13.236 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:12:13.236 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:12:13.237 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:13.237 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:13.237 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-mon.a.asok 2026-02-21T12:12:13.237 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:12:13.237 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.43953/ceph-mon.a.asok config get mon_host 2026-02-21T12:12:13.280 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:236: TEST_divergent_ec: run_mgr td/divergent-priors x 2026-02-21T12:12:13.280 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-21T12:12:13.280 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-21T12:12:13.280 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-21T12:12:13.280 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-21T12:12:13.280 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-21T12:12:13.280 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-21T12:12:13.382 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-21T12:12:13.382 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:12:13.383 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:12:13.383 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:12:13.383 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:13.383 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:13.383 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:12:13.384 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:12:13.384 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:12:13.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-21T12:12:13.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 0 2026-02-21T12:12:13.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-21T12:12:13.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:12:13.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-21T12:12:13.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:12:13.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-21T12:12:13.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:12:13.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:12:13.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:12:13.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:12:13.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-21T12:12:13.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-21T12:12:13.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:12:13.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:12:13.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:12:13.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:12:13.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:12:13.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:12:13.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:12:13.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:12:13.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:12:13.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:12:13.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-21T12:12:13.407 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:12:13.408 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e159c710-ae88-4e3c-a6dc-795db09f0a97 2026-02-21T12:12:13.408 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 e159c710-ae88-4e3c-a6dc-795db09f0a97' 2026-02-21T12:12:13.408 INFO:tasks.workunit.client.0.trial058.stdout:add osd0 e159c710-ae88-4e3c-a6dc-795db09f0a97 2026-02-21T12:12:13.408 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:12:13.417 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAdoZlp84mQGRAAQARHriouunSijyWBfK+p8A== 2026-02-21T12:12:13.417 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAdoZlp84mQGRAAQARHriouunSijyWBfK+p8A=="}' 2026-02-21T12:12:13.418 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e159c710-ae88-4e3c-a6dc-795db09f0a97 -i td/divergent-priors/0/new.json 2026-02-21T12:12:13.524 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:12:13.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-21T12:12:13.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAdoZlp84mQGRAAQARHriouunSijyWBfK+p8A== --osd-uuid e159c710-ae88-4e3c-a6dc-795db09f0a97 2026-02-21T12:12:13.551 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:13.561+0000 7fc191a32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:13.552 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:13.563+0000 7fc191a32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:13.553 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:13.564+0000 7fc191a32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:13.553 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:13.564+0000 7fc191a32780 -1 bdev(0x301ec00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-21T12:12:13.553 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:13.564+0000 7fc191a32780 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-21T12:12:13.969 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-21T12:12:13.970 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:12:13.970 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-21T12:12:13.971 INFO:tasks.workunit.client.0.trial058.stdout:adding osd0 key to auth repository 2026-02-21T12:12:13.971 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:12:14.078 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:12:14.079 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-21T12:12:14.079 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:12:14.080 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:12:14.080 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:12:14.080 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:12:14.097 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:14.107+0000 7faf35a71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:14.098 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:14.109+0000 7faf35a71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:14.099 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:14.109+0000 7faf35a71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:14.181 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-21T12:12:14.181 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:12:14.181 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:12:14.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:12:14.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:12:14.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:12:14.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:12:14.182 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:12:14.183 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:12:14.183 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:12:14.280 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:12:14.301 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:14.311+0000 7faf35a71780 -1 Falling back to public interface 2026-02-21T12:12:14.665 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:14.675+0000 7faf35a71780 -1 osd.0 0 log_to_monitors true 2026-02-21T12:12:15.281 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:12:15.282 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:12:15.282 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:12:15.282 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:12:15.282 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:12:15.282 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:12:15.383 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3704089841,v1:127.0.0.1:6801/3704089841] [v2:127.0.0.1:6802/3704089841,v1:127.0.0.1:6803/3704089841] exists,up e159c710-ae88-4e3c-a6dc-795db09f0a97 2026-02-21T12:12:15.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:12:15.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:12:15.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:12:15.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-21T12:12:15.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 1 2026-02-21T12:12:15.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-21T12:12:15.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:12:15.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-21T12:12:15.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:12:15.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-21T12:12:15.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:12:15.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:12:15.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:12:15.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:12:15.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-21T12:12:15.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-21T12:12:15.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:12:15.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:12:15.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:12:15.389 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:12:15.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:12:15.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:12:15.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:12:15.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:12:15.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:12:15.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:12:15.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-21T12:12:15.391 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:12:15.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6e6c6ffe-1b97-4e4f-8540-9377d41393d4 2026-02-21T12:12:15.391 INFO:tasks.workunit.client.0.trial058.stdout:add osd1 6e6c6ffe-1b97-4e4f-8540-9377d41393d4 2026-02-21T12:12:15.392 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 6e6c6ffe-1b97-4e4f-8540-9377d41393d4' 2026-02-21T12:12:15.392 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:12:15.400 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAfoZlpF8SOGBAAOFXfunMq8OgGNOjPdkdJsg== 2026-02-21T12:12:15.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAfoZlpF8SOGBAAOFXfunMq8OgGNOjPdkdJsg=="}' 2026-02-21T12:12:15.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6e6c6ffe-1b97-4e4f-8540-9377d41393d4 -i td/divergent-priors/1/new.json 2026-02-21T12:12:15.504 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:12:15.510 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-21T12:12:15.511 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAfoZlpF8SOGBAAOFXfunMq8OgGNOjPdkdJsg== --osd-uuid 6e6c6ffe-1b97-4e4f-8540-9377d41393d4 2026-02-21T12:12:15.530 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:15.540+0000 7f83da5d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:15.531 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:15.542+0000 7f83da5d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:15.532 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:15.542+0000 7f83da5d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:15.532 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:15.543+0000 7f83da5d8780 -1 bdev(0x3b9ec00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-21T12:12:15.533 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:15.543+0000 7f83da5d8780 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-21T12:12:15.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-21T12:12:15.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:12:15.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-21T12:12:15.845 INFO:tasks.workunit.client.0.trial058.stdout:adding osd1 key to auth repository 2026-02-21T12:12:15.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:12:16.164 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-21T12:12:16.164 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:12:16.165 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:12:16.165 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:12:16.165 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:12:16.166 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:12:16.182 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:16.192+0000 7f5b8762b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:16.183 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:16.193+0000 7f5b8762b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:16.184 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:16.194+0000 7f5b8762b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:16.318 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:16.329+0000 7f5b8762b780 -1 Falling back to public interface 2026-02-21T12:12:16.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-21T12:12:16.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:12:16.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:12:16.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:12:16.392 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:12:16.392 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:12:16.392 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:12:16.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:12:16.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:12:16.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:12:16.618 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:16.628+0000 7f5b8762b780 -1 osd.1 0 log_to_monitors true 2026-02-21T12:12:16.619 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:12:17.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:12:17.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:12:17.620 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:12:17.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:12:17.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:12:17.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:12:17.849 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2750512890,v1:127.0.0.1:6811/2750512890] [v2:127.0.0.1:6812/2750512890,v1:127.0.0.1:6813/2750512890] exists,up 6e6c6ffe-1b97-4e4f-8540-9377d41393d4 2026-02-21T12:12:17.856 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:12:17.856 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:12:17.856 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:12:17.856 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-21T12:12:17.857 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 2 2026-02-21T12:12:17.857 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-21T12:12:17.857 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:12:17.857 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-21T12:12:17.857 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:12:17.857 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-21T12:12:17.857 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:12:17.857 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:12:17.858 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ac2b1f6e-5c1b-494b-b046-e94fc885b5ad 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 ac2b1f6e-5c1b-494b-b046-e94fc885b5ad' 2026-02-21T12:12:17.859 INFO:tasks.workunit.client.0.trial058.stdout:add osd2 ac2b1f6e-5c1b-494b-b046-e94fc885b5ad 2026-02-21T12:12:17.860 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:12:17.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAhoZlpVPo8NBAAS8zEBh5f/QNdQgvp3EdCmg== 2026-02-21T12:12:17.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAhoZlpVPo8NBAAS8zEBh5f/QNdQgvp3EdCmg=="}' 2026-02-21T12:12:17.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ac2b1f6e-5c1b-494b-b046-e94fc885b5ad -i td/divergent-priors/2/new.json 2026-02-21T12:12:18.096 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:12:18.103 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-21T12:12:18.104 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAhoZlpVPo8NBAAS8zEBh5f/QNdQgvp3EdCmg== --osd-uuid ac2b1f6e-5c1b-494b-b046-e94fc885b5ad 2026-02-21T12:12:18.123 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:18.134+0000 7f7a87062780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:18.124 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:18.135+0000 7f7a87062780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:18.125 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:18.136+0000 7f7a87062780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:18.126 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:18.136+0000 7f7a87062780 -1 bdev(0x28fec00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-21T12:12:18.126 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:18.136+0000 7f7a87062780 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-21T12:12:18.440 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-21T12:12:18.441 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:12:18.441 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-21T12:12:18.442 INFO:tasks.workunit.client.0.trial058.stdout:adding osd2 key to auth repository 2026-02-21T12:12:18.442 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:12:18.760 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:12:18.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-21T12:12:18.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:12:18.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:12:18.762 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:12:18.762 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:12:18.779 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:18.789+0000 7fbbd560e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:18.780 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:18.791+0000 7fbbd560e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:18.781 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:18.791+0000 7fbbd560e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:18.908 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:18.918+0000 7fbbd560e780 -1 Falling back to public interface 2026-02-21T12:12:18.986 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-21T12:12:18.986 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:12:18.986 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:12:18.986 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:12:18.986 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:12:18.986 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:12:18.986 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:12:18.987 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:12:18.987 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:12:18.987 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:12:19.214 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:12:19.214 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:19.224+0000 7fbbd560e780 -1 osd.2 0 log_to_monitors true 2026-02-21T12:12:20.215 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:12:20.215 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:12:20.215 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:12:20.216 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:12:20.216 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:12:20.216 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:12:20.446 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3349747716,v1:127.0.0.1:6819/3349747716] [v2:127.0.0.1:6820/3349747716,v1:127.0.0.1:6821/3349747716] exists,up ac2b1f6e-5c1b-494b-b046-e94fc885b5ad 2026-02-21T12:12:20.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:12:20.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:12:20.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:12:20.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:242: TEST_divergent_ec: ceph osd set noout 2026-02-21T12:12:20.766 INFO:tasks.workunit.client.0.trial058.stderr:noout is set 2026-02-21T12:12:20.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:243: TEST_divergent_ec: ceph osd set noin 2026-02-21T12:12:21.069 INFO:tasks.workunit.client.0.trial058.stderr:noin is set 2026-02-21T12:12:21.078 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:244: TEST_divergent_ec: ceph osd set nodown 2026-02-21T12:12:21.372 INFO:tasks.workunit.client.0.trial058.stderr:nodown is set 2026-02-21T12:12:21.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:245: TEST_divergent_ec: create_ec_pool test true k=2 m=1 2026-02-21T12:12:21.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2550: create_ec_pool: local pool_name=test 2026-02-21T12:12:21.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2551: create_ec_pool: shift 2026-02-21T12:12:21.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2552: create_ec_pool: local allow_overwrites=true 2026-02-21T12:12:21.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2553: create_ec_pool: shift 2026-02-21T12:12:21.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2555: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-21T12:12:21.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2557: create_ec_pool: create_pool test 1 1 erasure myprofile 2026-02-21T12:12:21.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2026-02-21T12:12:22.042 INFO:tasks.workunit.client.0.trial058.stderr:pool 'test' already exists 2026-02-21T12:12:22.051 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-21T12:12:23.052 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2559: create_ec_pool: '[' true = true ']' 2026-02-21T12:12:23.053 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2560: create_ec_pool: ceph osd pool set test allow_ec_overwrites true 2026-02-21T12:12:23.371 INFO:tasks.workunit.client.0.trial058.stderr:set pool 1 allow_ec_overwrites to true 2026-02-21T12:12:23.382 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2563: create_ec_pool: wait_for_clean 2026-02-21T12:12:23.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:12:23.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:12:23.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:12:23.383 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-21T12:12:23.384 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:12:23.385 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:12:23.385 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:12:23.385 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:12:23.385 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:12:23.470 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-21T12:12:23.470 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:12:23.470 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:12:23.470 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:12:23.470 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:12:23.470 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:12:23.703 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:12:23.703 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:12:23.704 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:12:23.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:12:23.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:12:23.704 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:12:23.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836484 2026-02-21T12:12:23.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836484 2026-02-21T12:12:23.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836484' 2026-02-21T12:12:23.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:12:23.773 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:12:23.841 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=42949672964 2026-02-21T12:12:23.841 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 42949672964 2026-02-21T12:12:23.841 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836484 1-42949672964' 2026-02-21T12:12:23.841 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:12:23.841 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:12:23.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=64424509443 2026-02-21T12:12:23.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 64424509443 2026-02-21T12:12:23.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836484 1-42949672964 2-64424509443' 2026-02-21T12:12:23.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:12:23.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836484 2026-02-21T12:12:23.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:12:23.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:12:23.911 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836484 2026-02-21T12:12:23.911 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:12:23.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836484 2026-02-21T12:12:23.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-21T12:12:23.912 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836484 2026-02-21T12:12:23.912 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:12:24.140 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-21T12:12:24.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:12:25.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:12:25.142 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:12:25.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-21T12:12:25.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:12:26.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-21T12:12:26.371 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:12:26.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-21T12:12:26.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:12:26.609 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-42949672964 2026-02-21T12:12:26.610 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:12:26.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:12:26.611 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-42949672964 2026-02-21T12:12:26.611 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:12:26.612 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=42949672964 2026-02-21T12:12:26.612 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-21T12:12:26.613 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 42949672964 2026-02-21T12:12:26.613 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:12:26.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-21T12:12:26.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:12:26.845 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-64424509443 2026-02-21T12:12:26.845 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:12:26.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:12:26.846 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-64424509443 2026-02-21T12:12:26.846 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:12:26.847 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=64424509443 2026-02-21T12:12:26.848 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 64424509443 2026-02-21T12:12:26.848 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-21T12:12:26.848 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:12:27.082 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 64424509444 -lt 64424509443 2026-02-21T12:12:27.083 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:12:27.083 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:12:27.083 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:12:27.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:12:27.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:12:27.398 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:12:27.398 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:12:27.398 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:12:27.398 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:12:27.398 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:12:27.398 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:12:27.622 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-21T12:12:27.622 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:12:27.623 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:12:27.623 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:12:27.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-21T12:12:27.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:12:27.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:12:27.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2564: create_ec_pool: return 0 2026-02-21T12:12:27.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:247: TEST_divergent_ec: flush_pg_stats 2026-02-21T12:12:27.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:12:27.936 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:12:28.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:12:28.163 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:12:28.163 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:12:28.163 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:12:28.163 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:12:28.163 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:12:28.230 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836487 2026-02-21T12:12:28.231 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836487 2026-02-21T12:12:28.231 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836487' 2026-02-21T12:12:28.231 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:12:28.231 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:12:28.301 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=42949672967 2026-02-21T12:12:28.301 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 42949672967 2026-02-21T12:12:28.301 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836487 1-42949672967' 2026-02-21T12:12:28.301 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:12:28.301 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:12:28.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=64424509446 2026-02-21T12:12:28.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 64424509446 2026-02-21T12:12:28.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836487 1-42949672967 2-64424509446' 2026-02-21T12:12:28.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:12:28.370 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836487 2026-02-21T12:12:28.370 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:12:28.371 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:12:28.371 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836487 2026-02-21T12:12:28.371 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:12:28.372 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836487 2026-02-21T12:12:28.372 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-21T12:12:28.372 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836487 2026-02-21T12:12:28.373 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:12:28.601 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-21T12:12:28.601 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:12:29.601 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:12:29.602 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:12:29.831 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-21T12:12:29.831 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:12:29.832 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-42949672967 2026-02-21T12:12:29.832 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:12:29.833 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:12:29.833 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-42949672967 2026-02-21T12:12:29.833 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:12:29.834 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=42949672967 2026-02-21T12:12:29.834 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2026-02-21T12:12:29.835 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 42949672967 2026-02-21T12:12:29.835 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:12:30.063 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 42949672967 -lt 42949672967 2026-02-21T12:12:30.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:12:30.064 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-64424509446 2026-02-21T12:12:30.064 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:12:30.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:12:30.066 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-64424509446 2026-02-21T12:12:30.066 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:12:30.067 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=64424509446 2026-02-21T12:12:30.067 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2026-02-21T12:12:30.068 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 64424509446 2026-02-21T12:12:30.068 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:12:30.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 64424509446 -lt 64424509446 2026-02-21T12:12:30.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:248: TEST_divergent_ec: wait_for_clean 2026-02-21T12:12:30.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:12:30.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:12:30.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:12:30.296 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-21T12:12:30.297 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:12:30.297 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:12:30.297 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:12:30.297 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:12:30.297 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:12:30.384 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-21T12:12:30.384 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:12:30.384 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:12:30.384 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:12:30.384 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:12:30.384 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:12:30.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:12:30.611 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:12:30.611 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:12:30.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:12:30.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:12:30.611 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:12:30.681 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836490 2026-02-21T12:12:30.681 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836490 2026-02-21T12:12:30.681 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836490' 2026-02-21T12:12:30.681 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:12:30.681 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:12:30.749 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=42949672969 2026-02-21T12:12:30.749 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 42949672969 2026-02-21T12:12:30.749 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836490 1-42949672969' 2026-02-21T12:12:30.749 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:12:30.749 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:12:30.815 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=64424509449 2026-02-21T12:12:30.815 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 64424509449 2026-02-21T12:12:30.816 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836490 1-42949672969 2-64424509449' 2026-02-21T12:12:30.816 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:12:30.816 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836490 2026-02-21T12:12:30.816 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:12:30.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:12:30.817 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836490 2026-02-21T12:12:30.817 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:12:30.818 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836490 2026-02-21T12:12:30.818 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-21T12:12:30.819 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836490 2026-02-21T12:12:30.819 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:12:31.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836487 -lt 21474836490 2026-02-21T12:12:31.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:12:32.047 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:12:32.047 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:12:32.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-21T12:12:32.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:12:32.276 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:12:32.276 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-42949672969 2026-02-21T12:12:32.276 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:12:32.277 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-42949672969 2026-02-21T12:12:32.277 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:12:32.278 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=42949672969 2026-02-21T12:12:32.278 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2026-02-21T12:12:32.279 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 42949672969 2026-02-21T12:12:32.279 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:12:32.506 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 42949672969 -lt 42949672969 2026-02-21T12:12:32.506 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:12:32.506 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-64424509449 2026-02-21T12:12:32.506 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:12:32.508 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:12:32.509 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-64424509449 2026-02-21T12:12:32.509 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:12:32.510 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=64424509449 2026-02-21T12:12:32.510 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 64424509449' 2026-02-21T12:12:32.510 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 64424509449 2026-02-21T12:12:32.510 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:12:32.736 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 64424509449 -lt 64424509449 2026-02-21T12:12:32.737 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:12:32.737 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:12:32.737 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:12:33.058 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:12:33.059 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:12:33.059 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:12:33.059 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:12:33.059 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:12:33.059 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:12:33.059 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:12:33.059 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:12:33.281 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-21T12:12:33.281 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:12:33.281 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:12:33.282 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:12:33.595 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-21T12:12:33.595 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:12:33.595 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:12:33.596 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: ceph pg dump pgs --format=json 2026-02-21T12:12:33.596 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: jq '.pg_stats[0].up_primary' 2026-02-21T12:12:33.833 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:12:33.841 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: local divergent=1 2026-02-21T12:12:33.841 INFO:tasks.workunit.client.0.trial058.stdout:primary and soon to be divergent is 1 2026-02-21T12:12:33.841 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: echo 'primary and soon to be divergent is 1' 2026-02-21T12:12:33.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:253: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:12:34.056 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:12:34.057 INFO:tasks.workunit.client.0.trial058.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-21T12:12:22.695448+0000 0'0 29:20 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T21:28:15.333138+0000 0 0 2026-02-21T12:12:34.057 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:12:34.057 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:12:34.057 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:12:34.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:254: TEST_divergent_ec: local non_divergent= 2026-02-21T12:12:34.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-21T12:12:34.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 0 = 1 ']' 2026-02-21T12:12:34.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0' 2026-02-21T12:12:34.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-21T12:12:34.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 1 = 1 ']' 2026-02-21T12:12:34.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: continue 2026-02-21T12:12:34.066 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-21T12:12:34.066 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 2 = 1 ']' 2026-02-21T12:12:34.066 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0 2' 2026-02-21T12:12:34.066 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:263: TEST_divergent_ec: echo 'writing initial objects' 2026-02-21T12:12:34.066 INFO:tasks.workunit.client.0.trial058.stdout:writing initial objects 2026-02-21T12:12:34.067 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: seq 1 100 2026-02-21T12:12:34.067 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.067 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_1 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.085 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.085 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_2 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.104 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.105 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_3 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.123 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.124 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.143 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_5 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.161 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_6 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_7 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.198 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.199 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_8 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_9 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.237 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.238 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_10 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.256 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.257 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_11 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.276 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.276 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_12 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_13 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.313 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.313 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_14 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_15 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.350 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.350 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_16 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_17 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_18 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_19 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.426 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.426 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_20 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_21 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.464 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.465 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_22 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.483 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.483 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_23 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.503 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.503 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_24 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_25 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_26 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.562 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.562 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_27 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.581 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.581 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_28 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.600 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.600 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_29 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.618 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.618 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_30 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.638 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.638 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_31 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_32 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.676 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.676 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_33 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.696 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.696 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_34 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_35 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.734 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.734 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_36 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_37 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.771 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.771 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_38 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.790 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.791 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_39 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.809 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.809 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_40 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.828 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.828 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_41 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.846 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.847 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_42 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_43 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.885 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.885 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_44 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.903 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.903 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_45 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.922 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.922 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_46 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.941 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.942 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_47 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.960 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.960 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_48 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.979 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.979 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_49 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:34.998 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:34.998 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_50 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.017 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.017 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_51 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.036 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.036 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_52 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.055 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.055 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_53 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.075 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.075 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_54 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.094 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.094 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_55 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.112 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.112 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_56 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.131 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.131 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_57 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.150 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.151 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_58 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.169 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.169 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_59 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.187 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.187 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_60 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.206 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.206 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_61 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.225 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.225 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_62 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.244 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_63 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.263 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.263 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_64 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.281 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.281 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_65 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.299 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.299 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_66 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.317 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_67 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.336 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.336 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_68 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.355 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.355 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_69 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.374 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.374 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_70 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.392 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.392 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_71 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.410 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.410 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_72 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.429 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.429 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_73 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_74 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.466 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.466 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_75 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.485 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.485 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_76 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.503 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.503 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_77 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_78 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_79 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.559 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.560 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_80 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.578 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.578 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_81 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.598 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.598 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_82 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.617 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.617 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_83 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.634 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.635 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_84 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.654 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.654 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_85 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.673 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.673 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_86 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.692 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.692 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_87 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_88 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.729 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.729 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_89 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_90 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.767 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.767 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_91 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.786 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.786 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_92 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.805 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.805 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_93 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.824 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.824 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_94 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.844 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_95 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.862 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.863 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_96 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.881 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.881 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_97 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.901 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.901 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_98 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.920 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.920 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.938 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-21T12:12:35.938 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:35.958 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-21T12:12:35.958 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: wait_for_clean 2026-02-21T12:12:35.958 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:12:35.958 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:12:35.958 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:12:35.958 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-21T12:12:35.958 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:12:35.958 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:12:35.959 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:12:35.959 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:12:35.959 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:12:36.011 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-21T12:12:36.011 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:12:36.011 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:12:36.011 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:12:36.011 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:12:36.011 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:12:36.241 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:12:36.242 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:12:36.242 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:12:36.242 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:12:36.242 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:12:36.242 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:12:36.310 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=21474836493 2026-02-21T12:12:36.310 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 21474836493 2026-02-21T12:12:36.310 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836493' 2026-02-21T12:12:36.310 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:12:36.310 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:12:36.379 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=42949672972 2026-02-21T12:12:36.379 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 42949672972 2026-02-21T12:12:36.379 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836493 1-42949672972' 2026-02-21T12:12:36.379 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:12:36.379 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:12:36.444 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=64424509452 2026-02-21T12:12:36.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 64424509452 2026-02-21T12:12:36.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-21474836493 1-42949672972 2-64424509452' 2026-02-21T12:12:36.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:12:36.445 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-21474836493 2026-02-21T12:12:36.445 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:12:36.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:12:36.446 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-21474836493 2026-02-21T12:12:36.446 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:12:36.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=21474836493 2026-02-21T12:12:36.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-21T12:12:36.448 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 21474836493 2026-02-21T12:12:36.448 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:12:36.684 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836490 -lt 21474836493 2026-02-21T12:12:36.684 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:12:37.685 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:12:37.685 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:12:37.914 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-21T12:12:37.914 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:12:37.914 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-42949672972 2026-02-21T12:12:37.914 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:12:37.915 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:12:37.916 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-42949672972 2026-02-21T12:12:37.916 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:12:37.917 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=42949672972 2026-02-21T12:12:37.917 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 42949672972' 2026-02-21T12:12:37.917 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 42949672972 2026-02-21T12:12:37.917 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:12:38.145 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 42949672972 -lt 42949672972 2026-02-21T12:12:38.146 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:12:38.146 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-64424509452 2026-02-21T12:12:38.146 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:12:38.147 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:12:38.147 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-64424509452 2026-02-21T12:12:38.147 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:12:38.148 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=64424509452 2026-02-21T12:12:38.149 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 64424509452' 2026-02-21T12:12:38.149 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 64424509452 2026-02-21T12:12:38.149 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:12:38.381 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 64424509452 -lt 64424509452 2026-02-21T12:12:38.381 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:12:38.382 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:12:38.382 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:12:38.701 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:12:38.702 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:12:38.702 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:12:38.702 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:12:38.702 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:12:38.702 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:12:38.702 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:12:38.702 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:12:38.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-21T12:12:38.925 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:12:38.926 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:12:38.926 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:12:39.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-21T12:12:39.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:12:39.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:12:39.247 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: get_pg test existing_1 2026-02-21T12:12:39.247 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-21T12:12:39.247 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-21T12:12:39.247 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-21T12:12:39.247 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-21T12:12:39.479 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: local pgid=1.0 2026-02-21T12:12:39.480 INFO:tasks.workunit.client.0.trial058.stdout:blackholing osds 0 2 2026-02-21T12:12:39.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:275: TEST_divergent_ec: echo 'blackholing osds 0 2' 2026-02-21T12:12:39.480 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:276: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:12:39.697 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:12:39.697 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-21T12:12:22.695448+0000 29'100 29:120 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T21:28:15.333138+0000 0 0 2026-02-21T12:12:39.698 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:12:39.698 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:12:39.698 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:12:39.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-21T12:12:39.706 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.0 2026-02-21T12:12:39.706 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-21T12:12:39.706 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-21T12:12:39.706 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:12:39.706 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:39.707 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:39.707 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.0.asok 2026-02-21T12:12:39.707 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-21T12:12:39.707 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-21T12:12:39.748 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:12:39.748 INFO:tasks.workunit.client.0.trial058.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-21T12:12:39.748 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:12:39.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-21T12:12:39.753 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.2 2026-02-21T12:12:39.753 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-21T12:12:39.753 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-21T12:12:39.753 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:12:39.753 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:39.753 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:39.753 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.2.asok 2026-02-21T12:12:39.754 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-21T12:12:39.754 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-21T12:12:39.796 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:12:39.796 INFO:tasks.workunit.client.0.trial058.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-21T12:12:39.796 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:12:39.800 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:283: TEST_divergent_ec: echo 'writing divergent object' 2026-02-21T12:12:39.800 INFO:tasks.workunit.client.0.trial058.stdout:writing divergent object 2026-02-21T12:12:39.801 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:285: TEST_divergent_ec: sleep 1 2026-02-21T12:12:39.801 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:284: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.fQw6YkB5T3 2026-02-21T12:12:40.802 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:287: TEST_divergent_ec: rados -p test mksnap snap1 2026-02-21T12:12:40.802 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:286: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:40.872 INFO:tasks.workunit.client.0.trial058.stdout:created pool test snap snap1 2026-02-21T12:12:40.873 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: sleep 10 2026-02-21T12:12:40.873 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: expr 100 - 1 2026-02-21T12:12:40.874 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.qfK6uRIW7h 2026-02-21T12:12:50.874 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:290: TEST_divergent_ec: killall -9 rados 2026-02-21T12:12:50.903 INFO:tasks.workunit.client.0.trial058.stderr:rados: no process found 2026-02-21T12:12:50.903 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:293: TEST_divergent_ec: echo 'killing all the osds' 2026-02-21T12:12:50.903 INFO:tasks.workunit.client.0.trial058.stdout:killing all the osds 2026-02-21T12:12:50.904 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:294: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:12:51.128 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:12:51.128 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 active+clean 2026-02-21T12:12:22.695448+0000 30'104 30:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T14:41:54.358550+0000 0 0 2026-02-21T12:12:51.128 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:12:51.128 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:12:51.129 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:12:51.137 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:295: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd 2026-02-21T12:12:51.138 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:12:51.138 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:12:51.138 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:12:51.138 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:12:51.139 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:12:51.245 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:12:51.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-21T12:12:51.246 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.0 2026-02-21T12:12:51.527 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already down. 2026-02-21T12:12:51.534 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-21T12:12:51.535 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.1 2026-02-21T12:12:51.813 INFO:tasks.workunit.client.0.trial058.stderr:osd.1 is already down. 2026-02-21T12:12:51.820 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-21T12:12:51.820 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.2 2026-02-21T12:12:52.104 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already down. 2026-02-21T12:12:52.111 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-21T12:12:52.112 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.0 2026-02-21T12:12:52.393 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already out. 2026-02-21T12:12:52.400 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-21T12:12:52.400 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.2 2026-02-21T12:12:52.676 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already out. 2026-02-21T12:12:52.683 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:306: TEST_divergent_ec: echo 'bringing up non_divergent 0 2' 2026-02-21T12:12:52.684 INFO:tasks.workunit.client.0.trial058.stdout:bringing up non_divergent 0 2 2026-02-21T12:12:52.684 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:307: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:12:52.900 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:12:52.900 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 stale+active+clean 2026-02-21T12:12:22.695448+0000 30'104 30:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T14:41:54.358550+0000 0 0 2026-02-21T12:12:52.900 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:12:52.900 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:12:52.900 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:12:52.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:12:52.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:12:52.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:12:52.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:12:52.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:12:52.909 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:12:52.909 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:52.909 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:52.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:12:52.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:12:52.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:12:52.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:12:52.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:12:52.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:12:52.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:12:52.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:12:52.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:12:52.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:12:52.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:12:52.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-21T12:12:52.910 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:12:52.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-21T12:12:52.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:12:52.911 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-21T12:12:52.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-21T12:12:52.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:12:52.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:12:52.912 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:12:52.929 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:52.941+0000 7f02efe2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:52.931 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:52.942+0000 7f02efe2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:52.932 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:52.943+0000 7f02efe2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:53.116 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:53.128+0000 7f02efe2d780 -1 Falling back to public interface 2026-02-21T12:12:53.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-21T12:12:53.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:12:53.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:12:53.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:12:53.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:12:53.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:12:53.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:12:53.142 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:12:53.143 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:12:53.143 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:12:53.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:12:53.461 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:53.472+0000 7f02efe2d780 -1 osd.0 29 log_to_monitors true 2026-02-21T12:12:54.372 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:12:54.372 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:12:54.372 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:12:54.373 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:12:54.373 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:12:54.373 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:12:54.600 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up out weight 0 up_from 37 up_thru 0 down_at 31 last_clean_interval [5,29) [v2:127.0.0.1:6800/2553423647,v1:127.0.0.1:6801/2553423647] [v2:127.0.0.1:6802/2553423647,v1:127.0.0.1:6803/2553423647] exists,up e159c710-ae88-4e3c-a6dc-795db09f0a97 2026-02-21T12:12:54.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:12:54.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:12:54.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:12:54.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-21T12:12:54.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-21T12:12:54.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:12:54.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:12:54.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-21T12:12:54.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:12:54.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-21T12:12:54.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:12:54.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:12:54.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:12:54.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:12:54.606 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-21T12:12:54.606 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-21T12:12:54.606 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:12:54.606 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:12:54.606 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:12:54.606 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:12:54.606 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:12:54.606 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:12:54.607 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:12:54.608 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:12:54.608 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-21T12:12:54.608 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-21T12:12:54.608 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:12:54.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:12:54.609 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-21T12:12:54.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-21T12:12:54.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:12:54.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:12:54.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:12:54.622 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:54.633+0000 7fd14b452780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:54.623 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:54.635+0000 7fd14b452780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:54.624 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:54.636+0000 7fd14b452780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:12:54.777 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:54.788+0000 7fd14b452780 -1 Falling back to public interface 2026-02-21T12:12:54.840 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-21T12:12:54.840 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:12:54.840 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:12:54.840 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:12:54.840 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:12:54.841 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:12:54.841 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:12:54.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:12:54.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:12:54.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:12:55.072 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:12:55.093 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:12:55.104+0000 7fd14b452780 -1 osd.2 29 log_to_monitors true 2026-02-21T12:12:56.074 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:12:56.074 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:12:56.074 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:12:56.075 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:12:56.075 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:12:56.075 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:12:56.304 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up out weight 0 up_from 39 up_thru 0 down_at 33 last_clean_interval [15,29) [v2:127.0.0.1:6810/1206510609,v1:127.0.0.1:6811/1206510609] [v2:127.0.0.1:6812/1206510609,v1:127.0.0.1:6813/1206510609] exists,up ac2b1f6e-5c1b-494b-b046-e94fc885b5ad 2026-02-21T12:12:56.305 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:12:56.306 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:12:56.306 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:12:56.306 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-21T12:12:56.306 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.0 2026-02-21T12:12:56.553 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already in. 2026-02-21T12:12:56.560 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-21T12:12:56.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.2 2026-02-21T12:12:56.842 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already in. 2026-02-21T12:12:56.849 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:317: TEST_divergent_ec: sleep 5 2026-02-21T12:13:01.851 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: expr 2 + 2 2026-02-21T12:13:01.852 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: objname=existing_4 2026-02-21T12:13:01.853 INFO:tasks.workunit.client.0.trial058.stdout:writing non-divergent object existing_4 2026-02-21T12:13:01.853 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: echo 'writing non-divergent object existing_4' 2026-02-21T12:13:01.853 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:323: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:13:02.067 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:13:02.067 INFO:tasks.workunit.client.0.trial058.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-21T12:12:56.893811+0000 29'100 42:130 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T23:00:10.223746+0000 0 0 2026-02-21T12:13:02.067 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:13:02.067 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:13:02.068 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:13:02.074 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:324: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.fQw6YkB5T3 2026-02-21T12:13:02.095 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:325: TEST_divergent_ec: rm -f /tmp/tmp.fQw6YkB5T3 2026-02-21T12:13:02.096 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-21T12:13:02.096 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: wait_for_clean 2026-02-21T12:13:02.096 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:13:02.096 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:13:02.096 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:13:02.096 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-21T12:13:02.097 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:13:02.097 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:13:02.097 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:13:02.097 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:13:02.097 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:13:02.150 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-21T12:13:02.150 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:13:02.150 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:13:02.150 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:13:02.150 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:13:02.150 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:13:02.378 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:13:02.378 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:13:02.378 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:13:02.378 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:13:02.378 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:13:02.378 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:13:02.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=158913789956 2026-02-21T12:13:02.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 158913789956 2026-02-21T12:13:02.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-158913789956' 2026-02-21T12:13:02.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:13:02.446 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:13:02.496 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq= 2026-02-21T12:13:02.497 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: true 2026-02-21T12:13:02.497 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z '' 2026-02-21T12:13:02.497 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2289: flush_pg_stats: continue 2026-02-21T12:13:02.497 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:13:02.497 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:13:02.564 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=167503724548 2026-02-21T12:13:02.564 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 167503724548 2026-02-21T12:13:02.564 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-158913789956 2-167503724548' 2026-02-21T12:13:02.564 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:13:02.564 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-158913789956 2026-02-21T12:13:02.564 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:13:02.565 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:13:02.566 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-158913789956 2026-02-21T12:13:02.566 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:13:02.567 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=158913789956 2026-02-21T12:13:02.567 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 158913789956' 2026-02-21T12:13:02.567 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 158913789956 2026-02-21T12:13:02.567 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:13:02.795 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 158913789954 -lt 158913789956 2026-02-21T12:13:02.795 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:13:03.796 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:13:03.796 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:13:04.024 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 158913789956 -lt 158913789956 2026-02-21T12:13:04.024 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:13:04.024 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-167503724548 2026-02-21T12:13:04.025 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:13:04.025 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:13:04.026 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-167503724548 2026-02-21T12:13:04.026 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:13:04.028 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=167503724548 2026-02-21T12:13:04.028 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 167503724548' 2026-02-21T12:13:04.028 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 167503724548 2026-02-21T12:13:04.028 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:13:04.255 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 167503724548 -lt 167503724548 2026-02-21T12:13:04.256 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:13:04.256 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:04.256 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:04.573 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:13:04.573 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:04.573 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:04.573 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:04.573 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:04.573 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:04.574 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:04.574 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:04.795 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:04.796 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:04.796 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:04.796 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:05.112 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:05.112 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-21T12:13:05.112 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-21T12:13:05.112 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-21T12:13:05.113 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:05.113 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-21T12:13:05.213 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:05.213 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:05.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:05.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:05.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:05.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:05.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:05.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:05.441 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:05.441 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:05.442 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:05.442 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:05.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:05.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:05.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:05.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:05.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:05.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:05.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:05.759 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:05.760 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:06.071 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:06.071 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:06.072 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-21T12:13:06.072 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:06.072 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-21T12:13:06.272 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:06.272 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:06.273 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:06.274 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:06.274 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:06.274 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:06.274 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:06.274 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:06.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:06.500 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:06.500 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:06.501 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:06.825 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:06.825 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:06.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:06.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:06.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:06.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:06.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:06.826 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:06.826 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:07.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:07.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:07.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-21T12:13:07.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:07.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-21T12:13:07.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:07.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:07.543 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:07.543 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:07.544 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:07.544 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:07.544 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:07.544 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:07.770 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:07.770 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:07.771 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:07.771 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:08.084 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:08.084 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:08.084 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:08.084 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:08.084 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:08.084 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:08.084 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:08.084 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:08.085 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:08.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:08.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:08.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-21T12:13:08.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:08.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-21T12:13:09.202 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:09.202 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:09.203 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:09.203 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:09.203 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:09.203 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:09.204 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:09.204 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:09.428 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:09.438 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:09.439 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:09.440 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:09.745 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:09.746 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:09.746 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:09.746 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:09.746 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:09.746 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:09.746 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:09.746 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:09.746 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:10.058 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:10.058 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:10.059 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-21T12:13:10.059 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:10.059 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-21T12:13:11.659 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:11.660 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:11.660 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:11.660 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:11.660 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:11.660 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:11.661 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:11.661 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:11.887 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:11.888 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:11.888 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:11.888 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:12.201 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:12.201 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:12.201 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:12.201 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:12.201 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:12.201 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:12.201 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:12.201 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:12.201 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:12.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:12.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:12.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-21T12:13:12.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:12.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-21T12:13:15.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:15.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:15.719 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:15.720 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:15.720 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:15.720 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:15.720 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:15.720 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:15.945 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:15.945 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:15.945 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:15.946 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:16.261 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:16.262 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:16.262 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:16.262 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:16.262 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:16.262 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:16.262 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:16.262 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:16.262 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:16.588 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:16.588 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:16.588 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-21T12:13:16.589 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:16.589 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-21T12:13:22.990 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:22.990 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:22.990 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:22.990 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:22.990 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:22.990 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:22.990 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:22.991 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:23.213 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:23.213 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:23.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:23.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:23.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:23.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:23.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:23.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:23.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:23.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:23.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:23.532 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:23.532 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:23.851 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:23.851 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:23.851 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-21T12:13:23.851 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:23.851 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-21T12:13:31.152 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:31.152 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:31.153 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:31.153 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:31.153 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:31.153 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:31.153 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:31.154 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:31.377 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:31.377 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:31.378 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:31.378 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:31.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:31.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:31.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:31.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:31.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:31.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:31.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:31.695 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:31.696 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:32.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:32.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:32.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-21T12:13:32.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-21T12:13:32.322 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_fingerprint": "126b1ab4-5b83-4b1a-b7f6-d27a6cbefaf5", 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "version": "20.3.0-5397-gf7273f30", 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "commit": "f7273f3049146bdd7fa7b4a400114872a50228e9", 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "timestamp": "2026-02-21T12:13:32.334370+0000", 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "tag": "", 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "health": { 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "status": "HEALTH_WARN", 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "checks": { 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "OSDMAP_FLAGS": { 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-21T12:13:32.323 INFO:tasks.workunit.client.0.trial058.stdout: "count": 17 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [], 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: "OSD_DOWN": { 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: "message": "1 osds down", 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: "count": 1 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: "message": "osd.1 (root=default,host=trial058) is down" 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.324 INFO:tasks.workunit.client.0.trial058.stdout: "PG_DEGRADED": { 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: "count": 1 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: "mutes": [] 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_first_committed": 1, 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_last_committed": 1, 2026-02-21T12:13:32.325 INFO:tasks.workunit.client.0.trial058.stdout: "monmap": { 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:12:13.168117Z", 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:12:13.168117Z", 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release": 20, 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "election_strategy": 1, 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "disallowed_leaders": "", 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": false, 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "tiebreaker_mon": "", 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "removed_ranks": "", 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "features": { 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "persistent": [ 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "kraken", 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "luminous", 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "mimic", 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap-prune", 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "nautilus", 2026-02-21T12:13:32.326 INFO:tasks.workunit.client.0.trial058.stdout: "octopus", 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "pacific", 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "elector-pinging", 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "quincy", 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "reef", 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "squid", 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "tentacle", 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "nvmeof_beacon_diff" 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "optional": [] 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "mons": [ 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "rank": 0, 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "name": "a", 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.327 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115", 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 0 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115/0", 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: "priority": 0, 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 0, 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: "time_added": "2026-02-21T12:12:13:168112+0000", 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: "crush_location": [] 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: "quorum": [ 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: 0 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap": { 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 42, 2026-02-21T12:13:32.328 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:12:13.204178+0000", 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:12:56.890399+0000", 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "last_up_change": "2026-02-21T12:12:55.267323+0000", 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "last_in_change": "2026-02-21T12:12:56.787219+0000", 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "flags_num": 5800384, 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "flags_set": [ 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "nodown", 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "noin", 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "noout", 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "pglog_hardlimit", 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snapdirs", 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "recovery_deletes", 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "sortbitwise" 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "crush_version": 10, 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "full_ratio": 0.99000000953674316, 2026-02-21T12:13:32.329 INFO:tasks.workunit.client.0.trial058.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_snapshot": "", 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "pool_max": 1, 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "max_osd": 3, 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "require_min_compat_client": "luminous", 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "min_compat_client": "jewel", 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "require_osd_release": "tentacle", 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "allow_crimson": false, 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "pools": [ 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "pool_name": "test", 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "create_time": "2026-02-21T12:12:21.891265+0000", 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "flags": 16389, 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "type": 3, 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "size": 3, 2026-02-21T12:13:32.330 INFO:tasks.workunit.client.0.trial058.stdout: "min_size": 2, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "crush_rule": 1, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_count": 0, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_target": 0, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_barrier": 0, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "is_stretch_pool": false, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "object_hash": 2, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "pg_autoscale_mode": "off", 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num": 1, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num": 1, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num_target": 1, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_target": 1, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_pending": 1, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "last_pg_merge_meta": { 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "source_pgid": "0.0", 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "ready_epoch": 0, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_started": 0, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": 0, 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "source_version": "0'0", 2026-02-21T12:13:32.331 INFO:tasks.workunit.client.0.trial058.stdout: "target_version": "0'0" 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "last_change": "30", 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend": "0", 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_preluminous": "0", 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "auid": 0, 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "snap_mode": "pool", 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "snap_seq": 1, 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "snap_epoch": 30, 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "pool_snaps": [ 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "snapid": 1, 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "stamp": "2026-02-21T12:12:40.831803+0000", 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "name": "snap1" 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps": "[]", 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_bytes": 0, 2026-02-21T12:13:32.332 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_objects": 0, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "tiers": [], 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "tier_of": -1, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "read_tier": -1, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "write_tier": -1, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "cache_mode": "none", 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_bytes": 0, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_objects": 0, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_flush_age": 0, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_evict_age": 0, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profile": "myprofile", 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_params": { 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "type": "none" 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_period": 0, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_count": 0, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "use_gmt_hitset": true, 2026-02-21T12:13:32.333 INFO:tasks.workunit.client.0.trial058.stdout: "min_read_recency_for_promote": 0, 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "min_write_recency_for_promote": 0, 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_grade_decay_rate": 0, 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_search_last_n": 0, 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "grade_table": [], 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "stripe_width": 8192, 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "expected_num_objects": 0, 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "fast_read": false, 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "nonprimary_shards": "{}", 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "options": {}, 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "application_metadata": {} 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "osds": [ 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "e159c710-ae88-4e3c-a6dc-795db09f0a97", 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:13:32.334 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 5, 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 29, 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 37, 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 41, 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 31, 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6800", 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2553423647 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6801", 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2553423647 2026-02-21T12:13:32.335 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6802", 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2553423647 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6803", 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2553423647 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.336 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6806", 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2553423647 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6807", 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2553423647 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6804", 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2553423647 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.337 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6805", 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2553423647 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6801/2553423647", 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6803/2553423647", 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2553423647", 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2553423647", 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "6e6c6ffe-1b97-4e4f-8540-9377d41393d4", 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "up": 0, 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:13:32.338 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 0, 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 0, 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 10, 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 25, 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 32, 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.339 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.340 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:13:32.341 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/2750512890", 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/2750512890", 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2750512890", 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2750512890", 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "exists" 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "ac2b1f6e-5c1b-494b-b046-e94fc885b5ad", 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:13:32.342 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 15, 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 29, 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 39, 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 0, 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 33, 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1206510609 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1206510609 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.343 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1206510609 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1206510609 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.344 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1206510609 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1206510609 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1206510609 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:13:32.345 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 1206510609 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/1206510609", 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/1206510609", 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1206510609", 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1206510609", 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "osd_xinfo": [ 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:12:51.472334+0000", 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:13:32.346 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:12:15.651098+0000", 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:12:51.759031+0000", 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:12:17.651277+0000", 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:13:32.347 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:12:52.049345+0000", 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:12:20.202378+0000", 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap": [], 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_items": [], 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_primaries": [], 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "pg_temp": [], 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "primary_temp": [], 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "blocklist": {}, 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "range_blocklist": {}, 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profiles": { 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "default": { 2026-02-21T12:13:32.348 INFO:tasks.workunit.client.0.trial058.stdout: "k": "2", 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "m": "2", 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "plugin": "isa", 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "technique": "reed_sol_van" 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "myprofile": { 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "crush-device-class": "", 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "crush-failure-domain": "osd", 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "crush-num-failure-domains": "0", 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "crush-osds-per-failure-domain": "0", 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "crush-root": "default", 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "k": "2", 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "m": "1", 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "plugin": "isa", 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "technique": "reed_sol_van" 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps_queue": [], 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "new_removed_snaps": [], 2026-02-21T12:13:32.349 INFO:tasks.workunit.client.0.trial058.stdout: "new_purged_snaps": [], 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "crush_node_flags": {}, 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "device_class_flags": {}, 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": { 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_enabled": false, 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_bucket_count": 0, 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "degraded_stretch_mode": 0, 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "recovering_stretch_mode": 0, 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_bucket": 0 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "osd_metadata": [ 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6802/2553423647,v1:127.0.0.1:6803/2553423647]", 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:13:32.350 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:13:32.351 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:12:13.916698Z", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6800/2553423647,v1:127.0.0.1:6801/2553423647]", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2553423647,v1:127.0.0.1:6807/2553423647]", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2553423647,v1:127.0.0.1:6805/2553423647]", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:13:32.352 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/0", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/2750512890,v1:127.0.0.1:6813/2750512890]", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:13:32.353 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:13:32.354 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:12:15.812828Z", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/2750512890,v1:127.0.0.1:6811/2750512890]", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2750512890,v1:127.0.0.1:6817/2750512890]", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2750512890,v1:127.0.0.1:6815/2750512890]", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:13:32.355 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/1", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/1206510609,v1:127.0.0.1:6813/1206510609]", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:13:32.356 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:13:32.357 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:12:18.409928Z", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/1206510609,v1:127.0.0.1:6811/1206510609]", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1206510609,v1:127.0.0.1:6817/1206510609]", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1206510609,v1:127.0.0.1:6815/1206510609]", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:13:32.358 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/2", 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_clean_epochs": { 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "min_last_epoch_clean": 0, 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": { 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "per_pool": [] 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "osd_epochs": [ 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 37 2026-02-21T12:13:32.359 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 39 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_first_committed": 1, 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_last_committed": 42, 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: "crushmap": { 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: "devices": [ 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.0", 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.1", 2026-02-21T12:13:32.360 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.2", 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: "types": [ 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 0, 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd" 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: "name": "host" 2026-02-21T12:13:32.361 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 2, 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: "name": "chassis" 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 3, 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: "name": "rack" 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 4, 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: "name": "row" 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 5, 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pdu" 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 6, 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pod" 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.362 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 7, 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: "name": "room" 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 8, 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: "name": "datacenter" 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 9, 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: "name": "zone" 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 10, 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: "name": "region" 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: "name": "root" 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: "buckets": [ 2026-02-21T12:13:32.363 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "id": -1, 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default", 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "id": -2, 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default~ssd", 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:13:32.364 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058", 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:13:32.365 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058~ssd", 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.366 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "rules": [ 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "rule_id": 0, 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "rule_name": "replicated_rule", 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "type": 1, 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "steps": [ 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.367 INFO:tasks.workunit.client.0.trial058.stdout: "op": "take", 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: "item": -1, 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: "item_name": "default" 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: "op": "choose_firstn", 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: "num": 0, 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: "type": "osd" 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: "op": "emit" 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: "rule_id": 1, 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: "rule_name": "test", 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: "type": 3, 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: "steps": [ 2026-02-21T12:13:32.368 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.369 INFO:tasks.workunit.client.0.trial058.stderr:report 1409012681 2026-02-21T12:13:32.369 INFO:tasks.workunit.client.0.trial058.stdout: "op": "set_chooseleaf_tries", 2026-02-21T12:13:32.369 INFO:tasks.workunit.client.0.trial058.stdout: "num": 5 2026-02-21T12:13:32.369 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.369 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "op": "set_choose_tries", 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "num": 100 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "op": "take", 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "item": -1, 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "item_name": "default" 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "op": "choose_indep", 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "num": 0, 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "type": "osd" 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "op": "emit" 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "tunables": { 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_tries": 0, 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_fallback_tries": 0, 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "choose_total_tries": 50, 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_descend_once": 1, 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_vary_r": 1, 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_stable": 1, 2026-02-21T12:13:32.370 INFO:tasks.workunit.client.0.trial058.stdout: "msr_descents": 100, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "msr_collision_tries": 100, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "straw_calc_version": 1, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "allowed_bucket_algs": 54, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "profile": "jewel", 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "optimal_tunables": 1, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "legacy_tunables": 0, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "minimum_required_version": "jewel", 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables": 1, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables2": 1, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "has_v2_rules": 1, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables3": 1, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "has_v3_rules": 0, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "has_v4_buckets": 1, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables5": 1, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "has_v5_rules": 0, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "has_msr_rules": 0 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "choose_args": {} 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "fsmap": { 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "btime": "2026-02-21T12:12:13:204028+0000", 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "default_fscid": -1, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "compat": { 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "compat": {}, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "ro_compat": {}, 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "incompat": { 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "feature_1": "base v0.20", 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "feature_2": "client writeable ranges", 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "feature_3": "default file layouts on dirs", 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "feature_4": "dir inode in separate object", 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "feature_5": "mds uses versioned encoding", 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "feature_8": "no anchor table", 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "feature_9": "file layout v2", 2026-02-21T12:13:32.371 INFO:tasks.workunit.client.0.trial058.stdout: "feature_10": "snaprealm v2", 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "feature_11": "minor log segments", 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "feature_12": "quiesce subvolumes" 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "feature_flags": { 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "enable_multiple": true, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "ever_enabled_multiple": true 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "standbys": [], 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "filesystems": [] 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_first_committed": 1, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_last_committed": 1, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "auth": { 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 5, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_secrets": 3 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 1, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_active": 1, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_unknown": 0, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_osd": 3, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "pool_sum": { 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 52200, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 101, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 1, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 303, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 101, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 101, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:13:32.372 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 101, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 101, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 0, 2026-02-21T12:13:32.373 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 18, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 18, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "up": 3, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 3, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 0 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum": { 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 3, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 83924, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2148, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 23, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 81704, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314488876, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322036609024, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2199552, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 1541098, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 23812, 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 83665660 2026-02-21T12:13:32.374 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 0, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum_by_class": { 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "ssd": { 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 3, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 83924, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2148, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 23, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 81704, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314488876, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322036609024, 2026-02-21T12:13:32.375 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2199552, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 1541098, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 23812, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 83665660 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 0, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "pool_stats": [ 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": 1, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 1, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 52200, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 101, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 1, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 303, 2026-02-21T12:13:32.376 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 101, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 101, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 101, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 101, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:13:32.377 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 1241088, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 1241088, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 18, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 18, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "up": 3, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 3, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 3 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "osd_stats": [ 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 158913789962 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 42949672975 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 167503724554 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_state": [ 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "state": "active+undersized+degraded", 2026-02-21T12:13:32.378 INFO:tasks.workunit.client.0.trial058.stdout: "num": 1 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "pool_pg_unavailable_map": [ 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": "1", 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "pgs": [] 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_osd": [ 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2147483647, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 1, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 1, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 1, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 1, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 0, 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": [ 2026-02-21T12:13:32.379 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": {} 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "servicemap": { 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 3, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:13:19.418810+0000", 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "services": { 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "osd": { 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "daemons": { 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "summary": "", 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "0": { 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "start_epoch": 0, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "start_stamp": "0.000000", 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "gid": 0, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "metadata": {}, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "task_status": {} 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "2": { 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "start_epoch": 0, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "start_stamp": "0.000000", 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "gid": 0, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "metadata": {}, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "task_status": {} 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_first_committed": 1, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_last_committed": 40, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "logm_first_committed": 1, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "logm_last_committed": 233, 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "paxos": { 2026-02-21T12:13:32.380 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 326, 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stdout: "last_pn": 0, 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stdout: "accepted_pn": 0 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.0 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:13:32.381 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:13:32.437 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:13:32.437 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 0 --op log --pgid 1.0 2026-02-21T12:13:32.437 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-21T12:13:32.437 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-21T12:13:32.437 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-21T12:13:32.437 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-21T12:13:32.437 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/0 2026-02-21T12:13:32.437 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/0 --op log --pgid 1.0 2026-02-21T12:13:32.543 INFO:tasks.workunit.client.0.trial058.stderr:PG '1.0' not found 2026-02-21T12:13:32.582 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-21T12:13:32.582 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-21T12:13:32.582 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:13:32.582 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:13:32.583 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-21T12:13:32.584 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:13:32.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:13:32.585 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-21T12:13:32.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-21T12:13:32.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:13:32.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:13:32.585 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:13:32.600 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:13:32.611+0000 7fc83422c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:13:32.601 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:13:32.612+0000 7fc83422c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:13:32.602 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:13:32.613+0000 7fc83422c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:13:32.745 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:13:32.755+0000 7fc83422c780 -1 Falling back to public interface 2026-02-21T12:13:32.816 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-21T12:13:32.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:13:32.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:13:32.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:13:32.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:13:32.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:13:32.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:13:32.817 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:13:32.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:13:32.817 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:13:33.046 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 37 up_thru 41 down_at 31 last_clean_interval [5,29) [v2:127.0.0.1:6800/2553423647,v1:127.0.0.1:6801/2553423647] [v2:127.0.0.1:6802/2553423647,v1:127.0.0.1:6803/2553423647] exists,up e159c710-ae88-4e3c-a6dc-795db09f0a97 2026-02-21T12:13:33.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:13:33.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:13:33.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:13:33.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-21T12:13:33.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.2 2026-02-21T12:13:33.046 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:13:33.046 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:13:33.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:13:33.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:13:33.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:13:33.080 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:13:33.090+0000 7fc83422c780 -1 osd.0 42 log_to_monitors true 2026-02-21T12:13:33.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:13:33.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 2 --op log --pgid 1.0 2026-02-21T12:13:33.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-21T12:13:33.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-21T12:13:33.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-21T12:13:33.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-21T12:13:33.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/2 2026-02-21T12:13:33.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/2 --op log --pgid 1.0 2026-02-21T12:13:33.256 INFO:tasks.workunit.client.0.trial058.stderr:PG '1.0' not found 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:13:33.294 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:13:33.295 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:13:33.295 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:13:33.295 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:13:33.295 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:13:33.295 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:13:33.295 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-21T12:13:33.296 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-21T12:13:33.297 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:13:33.297 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:13:33.297 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:13:33.314 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:13:33.325+0000 7fc6a441e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:13:33.315 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:13:33.326+0000 7fc6a441e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:13:33.316 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:13:33.327+0000 7fc6a441e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:13:33.451 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:13:33.461+0000 7fc6a441e780 -1 Falling back to public interface 2026-02-21T12:13:33.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-21T12:13:33.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:13:33.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:13:33.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:13:33.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:13:33.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:13:33.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:13:33.530 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:13:33.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:13:33.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:13:33.760 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 39 up_thru 0 down_at 33 last_clean_interval [15,29) [v2:127.0.0.1:6810/1206510609,v1:127.0.0.1:6811/1206510609] [v2:127.0.0.1:6812/1206510609,v1:127.0.0.1:6813/1206510609] exists,up ac2b1f6e-5c1b-494b-b046-e94fc885b5ad 2026-02-21T12:13:33.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:13:33.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:13:33.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:13:33.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:336: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 1 --op log --pgid 1.0 2026-02-21T12:13:33.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-21T12:13:33.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-21T12:13:33.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-21T12:13:33.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-21T12:13:33.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-21T12:13:33.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op log --pgid 1.0 2026-02-21T12:13:33.799 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:13:33.810+0000 7fc6a441e780 -1 osd.2 42 log_to_monitors true 2026-02-21T12:13:33.868 INFO:tasks.workunit.client.0.trial058.stderr:PG '1.0' not found 2026-02-21T12:13:33.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-21T12:13:33.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-21T12:13:33.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: wait_for_clean 2026-02-21T12:13:33.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:13:33.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:13:33.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:13:33.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-21T12:13:33.909 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:13:33.909 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:13:33.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:13:33.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:13:33.909 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:13:33.961 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-21T12:13:33.961 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:13:33.961 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:13:33.961 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:13:33.961 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:13:33.961 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:13:34.191 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:13:34.191 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:13:34.191 INFO:tasks.workunit.client.0.trial058.stderr:2' 2026-02-21T12:13:34.191 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:13:34.191 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:13:34.192 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:13:34.261 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=193273528323 2026-02-21T12:13:34.261 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 193273528323 2026-02-21T12:13:34.261 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-193273528323' 2026-02-21T12:13:34.262 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:13:34.262 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:13:34.311 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq= 2026-02-21T12:13:34.312 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: true 2026-02-21T12:13:34.312 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z '' 2026-02-21T12:13:34.312 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2289: flush_pg_stats: continue 2026-02-21T12:13:34.312 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:13:34.312 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:13:34.379 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=210453397507 2026-02-21T12:13:34.380 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 210453397507 2026-02-21T12:13:34.380 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-193273528323 2-210453397507' 2026-02-21T12:13:34.380 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:13:34.380 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-193273528323 2026-02-21T12:13:34.380 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:13:34.381 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:13:34.381 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-193273528323 2026-02-21T12:13:34.381 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:13:34.382 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=193273528323 2026-02-21T12:13:34.383 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 193273528323 2026-02-21T12:13:34.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 193273528323' 2026-02-21T12:13:34.383 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:13:34.608 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 1 -lt 193273528323 2026-02-21T12:13:34.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:13:35.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:13:35.610 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:13:35.839 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 193273528323 -lt 193273528323 2026-02-21T12:13:35.839 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:13:35.840 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-210453397507 2026-02-21T12:13:35.840 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:13:35.840 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:13:35.841 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-210453397507 2026-02-21T12:13:35.841 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:13:35.842 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=210453397507 2026-02-21T12:13:35.842 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 210453397507 2026-02-21T12:13:35.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 210453397507' 2026-02-21T12:13:35.843 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:13:36.074 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 210453397507 -lt 210453397507 2026-02-21T12:13:36.074 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:13:36.075 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:36.075 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:36.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:13:36.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:36.394 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:36.394 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:36.394 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:36.394 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:36.394 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:36.394 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:36.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:36.620 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:36.621 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:36.621 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:36.935 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:36.935 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-21T12:13:36.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-21T12:13:36.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-21T12:13:36.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:36.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-21T12:13:37.036 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:37.036 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:37.037 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:37.037 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:37.037 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:37.037 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:37.037 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:37.037 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:37.265 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:37.265 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:37.266 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:37.266 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:37.580 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:37.580 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:37.580 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:37.580 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:37.580 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:37.580 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:37.581 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:37.581 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:37.581 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:37.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:37.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:37.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-21T12:13:37.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:37.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-21T12:13:38.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:38.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:38.099 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:38.099 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:38.099 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:38.099 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:38.099 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:38.099 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:38.324 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:38.324 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:38.325 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:38.325 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:38.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:38.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:38.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:38.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:38.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:38.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:38.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:38.639 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:38.639 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:38.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:38.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:38.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-21T12:13:38.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:38.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-21T12:13:39.355 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:39.355 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:39.355 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:39.355 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:39.355 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:39.355 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:39.356 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:39.356 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:39.579 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:39.580 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:39.580 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:39.580 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:39.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:39.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:39.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:39.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:39.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:39.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:39.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:39.896 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:39.896 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:40.210 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:40.210 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:40.211 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-21T12:13:40.211 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:40.211 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-21T12:13:41.013 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:41.013 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:41.014 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:41.014 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:41.014 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:41.014 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:41.014 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:41.015 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:41.238 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:41.238 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:41.239 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:41.239 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:41.551 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:41.551 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:41.552 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:41.552 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:41.552 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:41.552 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:41.552 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:41.552 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:41.552 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:41.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:41.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:41.867 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-21T12:13:41.867 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:41.867 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-21T12:13:43.466 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:43.466 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:43.467 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:43.467 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:43.468 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:43.468 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:43.468 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:43.468 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:43.691 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:43.692 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:43.692 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:43.692 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:44.005 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:44.005 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:44.005 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:44.005 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:44.005 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:44.005 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:44.005 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:44.006 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:44.006 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:44.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:44.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:44.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-21T12:13:44.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:44.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-21T12:13:47.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:47.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:47.531 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:47.531 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:47.531 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:47.531 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:47.531 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:47.532 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:47.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:47.759 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:47.759 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:47.759 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:48.072 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:48.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:48.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:48.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:48.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:48.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:48.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:48.073 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:48.073 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:48.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:48.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:48.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-21T12:13:48.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:48.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-21T12:13:54.790 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:13:54.790 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:13:54.791 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:13:54.791 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:13:54.791 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:13:54.791 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:13:54.791 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:13:54.791 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:13:55.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:13:55.020 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:13:55.020 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:13:55.020 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:13:55.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:13:55.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:13:55.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:13:55.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:13:55.333 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:13:55.333 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:13:55.333 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:13:55.333 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:13:55.333 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:13:55.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:13:55.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:13:55.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-21T12:13:55.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-21T12:13:55.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-21T12:14:02.951 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-21T12:14:02.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:14:02.952 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:14:02.952 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:14:02.952 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:14:02.952 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:14:02.953 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:14:02.953 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:14:03.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-21T12:14:03.181 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:14:03.181 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:14:03.181 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:14:03.495 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-21T12:14:03.495 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-21T12:14:03.495 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-21T12:14:03.495 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-21T12:14:03.495 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-21T12:14:03.495 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-21T12:14:03.495 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-21T12:14:03.496 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-21T12:14:03.496 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-21T12:14:03.814 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-21T12:14:03.815 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-21T12:14:03.815 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-21T12:14:03.815 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-21T12:14:04.125 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:14:04.125 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_fingerprint": "126b1ab4-5b83-4b1a-b7f6-d27a6cbefaf5", 2026-02-21T12:14:04.125 INFO:tasks.workunit.client.0.trial058.stdout: "version": "20.3.0-5397-gf7273f30", 2026-02-21T12:14:04.125 INFO:tasks.workunit.client.0.trial058.stdout: "commit": "f7273f3049146bdd7fa7b4a400114872a50228e9", 2026-02-21T12:14:04.125 INFO:tasks.workunit.client.0.trial058.stdout: "timestamp": "2026-02-21T12:14:04.136531+0000", 2026-02-21T12:14:04.125 INFO:tasks.workunit.client.0.trial058.stdout: "tag": "", 2026-02-21T12:14:04.126 INFO:tasks.workunit.client.0.trial058.stdout: "health": { 2026-02-21T12:14:04.126 INFO:tasks.workunit.client.0.trial058.stdout: "status": "HEALTH_WARN", 2026-02-21T12:14:04.126 INFO:tasks.workunit.client.0.trial058.stdout: "checks": { 2026-02-21T12:14:04.126 INFO:tasks.workunit.client.0.trial058.stdout: "OSDMAP_FLAGS": { 2026-02-21T12:14:04.126 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:14:04.126 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:14:04.126 INFO:tasks.workunit.client.0.trial058.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-21T12:14:04.126 INFO:tasks.workunit.client.0.trial058.stdout: "count": 17 2026-02-21T12:14:04.126 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.126 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [], 2026-02-21T12:14:04.126 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:14:04.127 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.127 INFO:tasks.workunit.client.0.trial058.stdout: "OSD_DOWN": { 2026-02-21T12:14:04.127 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:14:04.127 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:14:04.127 INFO:tasks.workunit.client.0.trial058.stdout: "message": "1 osds down", 2026-02-21T12:14:04.127 INFO:tasks.workunit.client.0.trial058.stdout: "count": 1 2026-02-21T12:14:04.127 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.127 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:14:04.127 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.127 INFO:tasks.workunit.client.0.trial058.stdout: "message": "osd.1 (root=default,host=trial058) is down" 2026-02-21T12:14:04.127 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.127 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.128 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:14:04.128 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.128 INFO:tasks.workunit.client.0.trial058.stdout: "PG_DEGRADED": { 2026-02-21T12:14:04.128 INFO:tasks.workunit.client.0.trial058.stdout: "severity": "HEALTH_WARN", 2026-02-21T12:14:04.128 INFO:tasks.workunit.client.0.trial058.stdout: "summary": { 2026-02-21T12:14:04.128 INFO:tasks.workunit.client.0.trial058.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-21T12:14:04.128 INFO:tasks.workunit.client.0.trial058.stdout: "count": 1 2026-02-21T12:14:04.128 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.128 INFO:tasks.workunit.client.0.trial058.stdout: "detail": [ 2026-02-21T12:14:04.128 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.128 INFO:tasks.workunit.client.0.trial058.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-21T12:14:04.129 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.129 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.129 INFO:tasks.workunit.client.0.trial058.stdout: "muted": false 2026-02-21T12:14:04.129 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.129 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.129 INFO:tasks.workunit.client.0.trial058.stdout: "mutes": [] 2026-02-21T12:14:04.129 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.129 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_first_committed": 1, 2026-02-21T12:14:04.129 INFO:tasks.workunit.client.0.trial058.stdout: "monmap_last_committed": 1, 2026-02-21T12:14:04.129 INFO:tasks.workunit.client.0.trial058.stdout: "monmap": { 2026-02-21T12:14:04.129 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:14:04.129 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:14:04.130 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:12:13.168117Z", 2026-02-21T12:14:04.130 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:12:13.168117Z", 2026-02-21T12:14:04.130 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release": 20, 2026-02-21T12:14:04.130 INFO:tasks.workunit.client.0.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-21T12:14:04.130 INFO:tasks.workunit.client.0.trial058.stdout: "election_strategy": 1, 2026-02-21T12:14:04.130 INFO:tasks.workunit.client.0.trial058.stdout: "disallowed_leaders": "", 2026-02-21T12:14:04.130 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": false, 2026-02-21T12:14:04.130 INFO:tasks.workunit.client.0.trial058.stdout: "tiebreaker_mon": "", 2026-02-21T12:14:04.130 INFO:tasks.workunit.client.0.trial058.stdout: "removed_ranks": "", 2026-02-21T12:14:04.130 INFO:tasks.workunit.client.0.trial058.stdout: "features": { 2026-02-21T12:14:04.130 INFO:tasks.workunit.client.0.trial058.stdout: "persistent": [ 2026-02-21T12:14:04.130 INFO:tasks.workunit.client.0.trial058.stdout: "kraken", 2026-02-21T12:14:04.131 INFO:tasks.workunit.client.0.trial058.stdout: "luminous", 2026-02-21T12:14:04.131 INFO:tasks.workunit.client.0.trial058.stdout: "mimic", 2026-02-21T12:14:04.131 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap-prune", 2026-02-21T12:14:04.131 INFO:tasks.workunit.client.0.trial058.stdout: "nautilus", 2026-02-21T12:14:04.131 INFO:tasks.workunit.client.0.trial058.stdout: "octopus", 2026-02-21T12:14:04.131 INFO:tasks.workunit.client.0.trial058.stdout: "pacific", 2026-02-21T12:14:04.131 INFO:tasks.workunit.client.0.trial058.stdout: "elector-pinging", 2026-02-21T12:14:04.131 INFO:tasks.workunit.client.0.trial058.stdout: "quincy", 2026-02-21T12:14:04.131 INFO:tasks.workunit.client.0.trial058.stdout: "reef", 2026-02-21T12:14:04.131 INFO:tasks.workunit.client.0.trial058.stdout: "squid", 2026-02-21T12:14:04.131 INFO:tasks.workunit.client.0.trial058.stdout: "tentacle", 2026-02-21T12:14:04.131 INFO:tasks.workunit.client.0.trial058.stdout: "nvmeof_beacon_diff" 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: "optional": [] 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: "mons": [ 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: "rank": 0, 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: "name": "a", 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115", 2026-02-21T12:14:04.132 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 0 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:7115/0", 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: "priority": 0, 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 0, 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: "time_added": "2026-02-21T12:12:13:168112+0000", 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: "crush_location": [] 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.133 INFO:tasks.workunit.client.0.trial058.stdout: "quorum": [ 2026-02-21T12:14:04.134 INFO:tasks.workunit.client.0.trial058.stdout: 0 2026-02-21T12:14:04.134 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.134 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap": { 2026-02-21T12:14:04.134 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 50, 2026-02-21T12:14:04.134 INFO:tasks.workunit.client.0.trial058.stdout: "fsid": "f112bd8f-5a4d-4e78-801e-db98a0eb1471", 2026-02-21T12:14:04.134 INFO:tasks.workunit.client.0.trial058.stdout: "created": "2026-02-21T12:12:13.204178+0000", 2026-02-21T12:14:04.134 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:13:34.126568+0000", 2026-02-21T12:14:04.134 INFO:tasks.workunit.client.0.trial058.stdout: "last_up_change": "2026-02-21T12:13:34.024514+0000", 2026-02-21T12:14:04.134 INFO:tasks.workunit.client.0.trial058.stdout: "last_in_change": "2026-02-21T12:12:56.787219+0000", 2026-02-21T12:14:04.134 INFO:tasks.workunit.client.0.trial058.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-21T12:14:04.134 INFO:tasks.workunit.client.0.trial058.stdout: "flags_num": 5800384, 2026-02-21T12:14:04.134 INFO:tasks.workunit.client.0.trial058.stdout: "flags_set": [ 2026-02-21T12:14:04.135 INFO:tasks.workunit.client.0.trial058.stdout: "nodown", 2026-02-21T12:14:04.135 INFO:tasks.workunit.client.0.trial058.stdout: "noin", 2026-02-21T12:14:04.135 INFO:tasks.workunit.client.0.trial058.stdout: "noout", 2026-02-21T12:14:04.135 INFO:tasks.workunit.client.0.trial058.stdout: "pglog_hardlimit", 2026-02-21T12:14:04.135 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snapdirs", 2026-02-21T12:14:04.135 INFO:tasks.workunit.client.0.trial058.stdout: "recovery_deletes", 2026-02-21T12:14:04.135 INFO:tasks.workunit.client.0.trial058.stdout: "sortbitwise" 2026-02-21T12:14:04.135 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.135 INFO:tasks.workunit.client.0.trial058.stdout: "crush_version": 12, 2026-02-21T12:14:04.135 INFO:tasks.workunit.client.0.trial058.stdout: "full_ratio": 0.99000000953674316, 2026-02-21T12:14:04.136 INFO:tasks.workunit.client.0.trial058.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-21T12:14:04.136 INFO:tasks.workunit.client.0.trial058.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-21T12:14:04.136 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_snapshot": "", 2026-02-21T12:14:04.136 INFO:tasks.workunit.client.0.trial058.stdout: "pool_max": 1, 2026-02-21T12:14:04.136 INFO:tasks.workunit.client.0.trial058.stdout: "max_osd": 3, 2026-02-21T12:14:04.136 INFO:tasks.workunit.client.0.trial058.stdout: "require_min_compat_client": "luminous", 2026-02-21T12:14:04.136 INFO:tasks.workunit.client.0.trial058.stdout: "min_compat_client": "jewel", 2026-02-21T12:14:04.136 INFO:tasks.workunit.client.0.trial058.stdout: "require_osd_release": "tentacle", 2026-02-21T12:14:04.136 INFO:tasks.workunit.client.0.trial058.stdout: "allow_crimson": false, 2026-02-21T12:14:04.136 INFO:tasks.workunit.client.0.trial058.stdout: "pools": [ 2026-02-21T12:14:04.136 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.136 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:14:04.137 INFO:tasks.workunit.client.0.trial058.stdout: "pool_name": "test", 2026-02-21T12:14:04.137 INFO:tasks.workunit.client.0.trial058.stdout: "create_time": "2026-02-21T12:12:21.891265+0000", 2026-02-21T12:14:04.137 INFO:tasks.workunit.client.0.trial058.stdout: "flags": 16389, 2026-02-21T12:14:04.137 INFO:tasks.workunit.client.0.trial058.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-21T12:14:04.137 INFO:tasks.workunit.client.0.trial058.stdout: "type": 3, 2026-02-21T12:14:04.137 INFO:tasks.workunit.client.0.trial058.stdout: "size": 3, 2026-02-21T12:14:04.137 INFO:tasks.workunit.client.0.trial058.stdout: "min_size": 2, 2026-02-21T12:14:04.137 INFO:tasks.workunit.client.0.trial058.stdout: "crush_rule": 1, 2026-02-21T12:14:04.137 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_count": 0, 2026-02-21T12:14:04.137 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_target": 0, 2026-02-21T12:14:04.137 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_barrier": 0, 2026-02-21T12:14:04.137 INFO:tasks.workunit.client.0.trial058.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-21T12:14:04.138 INFO:tasks.workunit.client.0.trial058.stdout: "is_stretch_pool": false, 2026-02-21T12:14:04.138 INFO:tasks.workunit.client.0.trial058.stdout: "object_hash": 2, 2026-02-21T12:14:04.138 INFO:tasks.workunit.client.0.trial058.stdout: "pg_autoscale_mode": "off", 2026-02-21T12:14:04.138 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num": 1, 2026-02-21T12:14:04.138 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num": 1, 2026-02-21T12:14:04.138 INFO:tasks.workunit.client.0.trial058.stdout: "pg_placement_num_target": 1, 2026-02-21T12:14:04.138 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_target": 1, 2026-02-21T12:14:04.138 INFO:tasks.workunit.client.0.trial058.stdout: "pg_num_pending": 1, 2026-02-21T12:14:04.138 INFO:tasks.workunit.client.0.trial058.stdout: "last_pg_merge_meta": { 2026-02-21T12:14:04.138 INFO:tasks.workunit.client.0.trial058.stdout: "source_pgid": "0.0", 2026-02-21T12:14:04.138 INFO:tasks.workunit.client.0.trial058.stdout: "ready_epoch": 0, 2026-02-21T12:14:04.138 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_started": 0, 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": 0, 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: "source_version": "0'0", 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: "target_version": "0'0" 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: "last_change": "30", 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend": "0", 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: "last_force_op_resend_preluminous": "0", 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: "auid": 0, 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: "snap_mode": "pool", 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: "snap_seq": 1, 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: "snap_epoch": 30, 2026-02-21T12:14:04.139 INFO:tasks.workunit.client.0.trial058.stdout: "pool_snaps": [ 2026-02-21T12:14:04.140 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.140 INFO:tasks.workunit.client.0.trial058.stdout: "snapid": 1, 2026-02-21T12:14:04.140 INFO:tasks.workunit.client.0.trial058.stdout: "stamp": "2026-02-21T12:12:40.831803+0000", 2026-02-21T12:14:04.140 INFO:tasks.workunit.client.0.trial058.stdout: "name": "snap1" 2026-02-21T12:14:04.140 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.140 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.140 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps": "[]", 2026-02-21T12:14:04.140 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_bytes": 0, 2026-02-21T12:14:04.140 INFO:tasks.workunit.client.0.trial058.stdout: "quota_max_objects": 0, 2026-02-21T12:14:04.140 INFO:tasks.workunit.client.0.trial058.stdout: "tiers": [], 2026-02-21T12:14:04.140 INFO:tasks.workunit.client.0.trial058.stdout: "tier_of": -1, 2026-02-21T12:14:04.140 INFO:tasks.workunit.client.0.trial058.stdout: "read_tier": -1, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "write_tier": -1, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "cache_mode": "none", 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_bytes": 0, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "target_max_objects": 0, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_flush_age": 0, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "cache_min_evict_age": 0, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profile": "myprofile", 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_params": { 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "type": "none" 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_period": 0, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_count": 0, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "use_gmt_hitset": true, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "min_read_recency_for_promote": 0, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "min_write_recency_for_promote": 0, 2026-02-21T12:14:04.141 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_grade_decay_rate": 0, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "hit_set_search_last_n": 0, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "grade_table": [], 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "stripe_width": 8192, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "expected_num_objects": 0, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "fast_read": false, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "nonprimary_shards": "{}", 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "options": {}, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "application_metadata": {} 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "osds": [ 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "e159c710-ae88-4e3c-a6dc-795db09f0a97", 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 37, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 42, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 45, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 49, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 44, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.142 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6800", 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 941335224 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6801", 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 941335224 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6802", 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 941335224 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6803", 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 941335224 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.143 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6806", 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 941335224 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6807", 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 941335224 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6804", 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 941335224 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6805", 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 941335224 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6801/941335224", 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6803/941335224", 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6807/941335224", 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6805/941335224", 2026-02-21T12:14:04.144 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "6e6c6ffe-1b97-4e4f-8540-9377d41393d4", 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "up": 0, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 0, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 0, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 10, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 25, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 32, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:14:04.145 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:14:04.146 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 2750512890 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/2750512890", 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/2750512890", 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2750512890", 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2750512890", 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "exists" 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "uuid": "ac2b1f6e-5c1b-494b-b046-e94fc885b5ad", 2026-02-21T12:14:04.147 INFO:tasks.workunit.client.0.trial058.stdout: "up": 1, 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "in": 1, 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 1, 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "primary_affinity": 1, 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_begin": 39, 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "last_clean_end": 42, 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 49, 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "up_thru": 0, 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "down_at": 48, 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "lost_at": 0, 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "public_addrs": { 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6810", 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3549491657 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6811", 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3549491657 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addrs": { 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6812", 2026-02-21T12:14:04.148 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3549491657 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6813", 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3549491657 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addrs": { 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6816", 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3549491657 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6817", 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3549491657 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addrs": { 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "addrvec": [ 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v2", 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6814", 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3549491657 2026-02-21T12:14:04.149 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "type": "v1", 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "127.0.0.1:6815", 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "nonce": 3549491657 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "public_addr": "127.0.0.1:6811/3549491657", 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "cluster_addr": "127.0.0.1:6813/3549491657", 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3549491657", 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3549491657", 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "state": [ 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "exists", 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "up" 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "osd_xinfo": [ 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:13:33.212585+0000", 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:12:15.651098+0000", 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.150 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:12:51.759031+0000", 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:12:17.651277+0000", 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "down_stamp": "2026-02-21T12:13:33.922587+0000", 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_probability": 0, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "laggy_interval": 0, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "features": 4544132024016699391, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "old_weight": 0, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "last_purged_snaps_scrub": "2026-02-21T12:12:20.202378+0000", 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "dead_epoch": 0 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap": [], 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_items": [], 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "pg_upmap_primaries": [], 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "pg_temp": [], 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "primary_temp": [], 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "blocklist": {}, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "range_blocklist": {}, 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "erasure_code_profiles": { 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "default": { 2026-02-21T12:14:04.151 INFO:tasks.workunit.client.0.trial058.stdout: "k": "2", 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "m": "2", 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "plugin": "isa", 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "technique": "reed_sol_van" 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "myprofile": { 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "crush-device-class": "", 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "crush-failure-domain": "osd", 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "crush-num-failure-domains": "0", 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "crush-osds-per-failure-domain": "0", 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "crush-root": "default", 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "k": "2", 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "m": "1", 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "plugin": "isa", 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "technique": "reed_sol_van" 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "removed_snaps_queue": [], 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "new_removed_snaps": [], 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "new_purged_snaps": [], 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "crush_node_flags": {}, 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "device_class_flags": {}, 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode": { 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_enabled": false, 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_bucket_count": 0, 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "degraded_stretch_mode": 0, 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "recovering_stretch_mode": 0, 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "stretch_mode_bucket": 0 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.152 INFO:tasks.workunit.client.0.trial058.stdout: "osd_metadata": [ 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6802/941335224,v1:127.0.0.1:6803/941335224]", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:14:04.153 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:12:13.916698Z", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6800/941335224,v1:127.0.0.1:6801/941335224]", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/941335224,v1:127.0.0.1:6807/941335224]", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/941335224,v1:127.0.0.1:6805/941335224]", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/0", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.154 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/2750512890,v1:127.0.0.1:6813/2750512890]", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:14:04.155 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:12:15.812828Z", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/2750512890,v1:127.0.0.1:6811/2750512890]", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2750512890,v1:127.0.0.1:6817/2750512890]", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2750512890,v1:127.0.0.1:6815/2750512890]", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/1", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "arch": "x86_64", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "back_addr": "[v2:127.0.0.1:6812/3549491657,v1:127.0.0.1:6813/3549491657]", 2026-02-21T12:14:04.156 INFO:tasks.workunit.client.0.trial058.stdout: "back_iface": "", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs": "1", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_db": "0", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_dedicated_wal": "0", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluefs_single_shared_device": "1", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocation_from_file": "1", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_allocator": "hybrid", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_access_mode": "file", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_block_size": "4096", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_rotational": "0", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_size": "107374182400", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_support_discard": "1", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_bdev_type": "ssd", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_min_alloc_size": "4096", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "bluestore_write_mode": "classic", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_release": "tentacle", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_short": "20.3.0-5397-gf7273f30", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "ceph_version_when_created": "ceph version 20.3.0-5397-gf7273f30 (f7273f3049146bdd7fa7b4a400114872a50228e9) tentacle (dev - RelWithDebInfo)", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "created_at": "2026-02-21T12:12:18.409928Z", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "default_device_class": "ssd", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FB000FC", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-21T12:14:04.157 INFO:tasks.workunit.client.0.trial058.stdout: "devices": "nvme2n1", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "distro": "centos", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "distro_version": "9", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "front_addr": "[v2:127.0.0.1:6810/3549491657,v1:127.0.0.1:6811/3549491657]", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "front_iface": "", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3549491657,v1:127.0.0.1:6817/3549491657]", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3549491657,v1:127.0.0.1:6815/3549491657]", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "hostname": "trial058", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "journal_rotational": "0", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "mem_total_kb": "130438944", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_node": "0", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "objectstore_numa_nodes": "0", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "os": "Linux", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "osd_data": "td/divergent-priors/2", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "osd_objectstore": "bluestore", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "osdspec_affinity": "", 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "rotational": "0" 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_clean_epochs": { 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "min_last_epoch_clean": 26, 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "last_epoch_clean": { 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "per_pool": [ 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": 1, 2026-02-21T12:14:04.158 INFO:tasks.workunit.client.0.trial058.stdout: "floor": 26 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "osd_epochs": [ 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 50 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 50 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_first_committed": 1, 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "osdmap_last_committed": 50, 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "crushmap": { 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "devices": [ 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.0", 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.1", 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.159 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd.2", 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "class": "ssd" 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "types": [ 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 0, 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "name": "osd" 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "name": "host" 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 2, 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "name": "chassis" 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 3, 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "name": "rack" 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 4, 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "name": "row" 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 5, 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pdu" 2026-02-21T12:14:04.160 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 6, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "name": "pod" 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 7, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "name": "room" 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 8, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "name": "datacenter" 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 9, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "name": "zone" 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 10, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "name": "region" 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "name": "root" 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "buckets": [ 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "id": -1, 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default", 2026-02-21T12:14:04.161 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "id": -2, 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "name": "default~ssd", 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 11, 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "root", 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.162 INFO:tasks.workunit.client.0.trial058.stdout: "id": -3, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058", 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "id": -4, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "name": "trial058~ssd", 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "type_id": 1, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "type_name": "host", 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 19206, 2026-02-21T12:14:04.163 INFO:tasks.workunit.client.0.trial058.stdout: "alg": "straw2", 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "hash": "rjenkins1", 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "items": [ 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "id": 0, 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 0 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "id": 1, 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 1 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "id": 2, 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "weight": 6402, 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "pos": 2 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "rules": [ 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "rule_id": 0, 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "rule_name": "replicated_rule", 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "type": 1, 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "steps": [ 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "op": "take", 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "item": -1, 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: "item_name": "default" 2026-02-21T12:14:04.164 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: "op": "choose_firstn", 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: "num": 0, 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: "type": "osd" 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: "op": "emit" 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: "rule_id": 1, 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: "rule_name": "test", 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stderr:report 1943163299 2026-02-21T12:14:04.165 INFO:tasks.workunit.client.0.trial058.stdout: "type": 3, 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "steps": [ 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "op": "set_chooseleaf_tries", 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "num": 5 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "op": "set_choose_tries", 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "num": 100 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "op": "take", 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "item": -1, 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "item_name": "default" 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "op": "choose_indep", 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "num": 0, 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "type": "osd" 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "op": "emit" 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: ] 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "tunables": { 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_tries": 0, 2026-02-21T12:14:04.166 INFO:tasks.workunit.client.0.trial058.stdout: "choose_local_fallback_tries": 0, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "choose_total_tries": 50, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_descend_once": 1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_vary_r": 1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "chooseleaf_stable": 1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "msr_descents": 100, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "msr_collision_tries": 100, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "straw_calc_version": 1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "allowed_bucket_algs": 54, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "profile": "jewel", 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "optimal_tunables": 1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "legacy_tunables": 0, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "minimum_required_version": "jewel", 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables": 1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables2": 1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "has_v2_rules": 1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables3": 1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "has_v3_rules": 0, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "has_v4_buckets": 1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "require_feature_tunables5": 1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "has_v5_rules": 0, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "has_msr_rules": 0 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "choose_args": {} 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "fsmap": { 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "btime": "2026-02-21T12:12:13:204028+0000", 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "default_fscid": -1, 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "compat": { 2026-02-21T12:14:04.167 INFO:tasks.workunit.client.0.trial058.stdout: "compat": {}, 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "ro_compat": {}, 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "incompat": { 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "feature_1": "base v0.20", 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "feature_2": "client writeable ranges", 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "feature_3": "default file layouts on dirs", 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "feature_4": "dir inode in separate object", 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "feature_5": "mds uses versioned encoding", 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "feature_8": "no anchor table", 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "feature_9": "file layout v2", 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "feature_10": "snaprealm v2", 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "feature_11": "minor log segments", 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "feature_12": "quiesce subvolumes" 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "feature_flags": { 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "enable_multiple": true, 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "ever_enabled_multiple": true 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "standbys": [], 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "filesystems": [] 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_first_committed": 1, 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "mdsmap_last_committed": 1, 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "auth": { 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 5, 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "num_secrets": 3 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.168 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 1, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_active": 1, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_unknown": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_osd": 3, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "pool_sum": { 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 52200, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 101, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 1, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 303, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 101, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 101, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 101, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 101, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:14:04.169 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 18, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 18, 2026-02-21T12:14:04.170 INFO:tasks.workunit.client.0.trial058.stdout: "up": 3, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 3, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 0 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum": { 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 3, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 85076, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2276, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 27, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 82724, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314487724, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322035429376, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2330624, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 1595038, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 27695, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 84710353 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:14:04.171 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 0, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "osd_sum_by_class": { 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "ssd": { 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "up_from": 0, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 0, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "num_pgs": 3, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "num_osds": 3, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_osds": 3, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "num_per_pool_omap_osds": 3, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "kb": 314572800, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used": 85076, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_data": 2276, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_omap": 27, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "kb_used_meta": 82724, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "kb_avail": 314487724, 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "statfs": { 2026-02-21T12:14:04.172 INFO:tasks.workunit.client.0.trial058.stdout: "total": 322122547200, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "available": 322035429376, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 2330624, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 1595038, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 27695, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 84710353 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "hb_peers": [], 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "snap_trim_queue_len": 0, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "num_snap_trimming": 0, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "num_shards_repaired": 0, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "op_queue_age_hist": { 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "histogram": [], 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "upper_bound": 1 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "perf_stat": { 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ms": 0, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ms": 0, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "commit_latency_ns": 0, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "apply_latency_ns": 0 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "alerts": [], 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "network_ping_times": [] 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "pool_stats": [ 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.173 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": 1, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg": 1, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "stat_sum": { 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes": 52200, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects": 101, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_clones": 1, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_object_copies": 303, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing_on_primary": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_missing": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_degraded": 101, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_misplaced": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_unfound": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_dirty": 101, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_whiteouts": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_read": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_read_kb": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_write": 101, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_write_kb": 101, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_scrub_errors": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_shallow_scrub_errors": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_deep_scrub_errors": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_recovered": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_recovered": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_keys_recovered": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_omap": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_hit_set_archive": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_bytes_hit_set_archive": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_kb": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_kb": 0, 2026-02-21T12:14:04.174 INFO:tasks.workunit.client.0.trial058.stdout: "num_promote": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_high": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "num_flush_mode_low": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_some": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "num_evict_mode_full": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_pinned": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "num_legacy_snapsets": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "num_large_omap_objects": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_manifest": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_bytes": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "num_omap_keys": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "num_objects_repaired": 0 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "store_stats": { 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "total": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "available": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "internally_reserved": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "allocated": 1241088, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "data_stored": 1241088, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_allocated": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "data_compressed_original": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "omap_allocated": 0, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "internal_metadata": 0 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "log_size": 18, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "ondisk_log_size": 18, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "up": 3, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "acting": 3, 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: "num_store_stats": 3 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.175 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "osd_stats": [ 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 193273528329 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 42949672975 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "seq": 210453397512 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_state": [ 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "state": "active+undersized+degraded", 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "num": 1 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "pool_pg_unavailable_map": [ 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "poolid": "1", 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "pgs": [] 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "num_pg_by_osd": [ 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2147483647, 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:14:04.176 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 1, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 2, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 1, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 0, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 1, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 1, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "osd": 1, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "num_primary_pg": 0, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "num_acting_pg": 0, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "num_up_not_acting_pg": 0 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": [ 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: { 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "pool": 1, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "purged_snaps": {} 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: ], 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "servicemap": { 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "epoch": 3, 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "modified": "2026-02-21T12:13:19.418810+0000", 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "services": { 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "osd": { 2026-02-21T12:14:04.177 INFO:tasks.workunit.client.0.trial058.stdout: "daemons": { 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "summary": "", 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "0": { 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "start_epoch": 0, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "start_stamp": "0.000000", 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "gid": 0, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "metadata": {}, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "task_status": {} 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "2": { 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "start_epoch": 0, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "start_stamp": "0.000000", 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "gid": 0, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "metadata": {}, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "task_status": {} 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: }, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_first_committed": 1, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "mgrstat_last_committed": 56, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "logm_first_committed": 1, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "logm_last_committed": 309, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "paxos": { 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "first_committed": 1, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "last_committed": 426, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "last_pn": 0, 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: "accepted_pn": 0 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout: } 2026-02-21T12:14:04.178 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:14:04.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-21T12:14:04.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:341: TEST_divergent_ec: echo 'delay recovery' 2026-02-21T12:14:04.179 INFO:tasks.workunit.client.0.trial058.stdout:delay recovery 2026-02-21T12:14:04.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:342: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:14:04.347 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:14:04.347 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-21T12:13:34.132778+0000 42'102 50:144 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T20:04:55.743939+0000 0 0 2026-02-21T12:14:04.347 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:14:04.347 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:14:04.347 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:14:04.354 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-21T12:14:04.354 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.0 2026-02-21T12:14:04.355 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-21T12:14:04.355 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-21T12:14:04.355 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:14:04.355 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:04.355 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:14:04.355 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.0.asok 2026-02-21T12:14:04.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-21T12:14:04.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.0.asok set_recovery_delay 100000 2026-02-21T12:14:04.401 INFO:tasks.workunit.client.0.trial058.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-21T12:14:04.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-21T12:14:04.405 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.2 2026-02-21T12:14:04.405 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-21T12:14:04.405 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-21T12:14:04.405 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:14:04.405 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:04.406 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:14:04.406 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.2.asok 2026-02-21T12:14:04.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-21T12:14:04.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.2.asok set_recovery_delay 100000 2026-02-21T12:14:04.451 INFO:tasks.workunit.client.0.trial058.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-21T12:14:04.454 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:349: TEST_divergent_ec: echo 'revive divergent 1' 2026-02-21T12:14:04.454 INFO:tasks.workunit.client.0.trial058.stdout:revive divergent 1 2026-02-21T12:14:04.454 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:350: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:14:04.680 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:14:04.680 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-21T12:13:34.132778+0000 42'102 50:144 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T20:04:55.743939+0000 0 0 2026-02-21T12:14:04.680 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:14:04.681 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:14:04.681 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:14:04.687 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:351: TEST_divergent_ec: ceph osd set noup 2026-02-21T12:14:05.006 INFO:tasks.workunit.client.0.trial058.stderr:noup is set 2026-02-21T12:14:05.018 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:352: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-21T12:14:05.018 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:14:05.019 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:14:05.020 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:14:05.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:14:05.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:14:05.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:14:05.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:14:05.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-21T12:14:05.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-21T12:14:05.021 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:14:05.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:14:05.022 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-21T12:14:05.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-21T12:14:05.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:14:05.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:14:05.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:14:05.037 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:05.048+0000 7f2bc4c14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:05.038 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:05.049+0000 7f2bc4c14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:05.039 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:05.050+0000 7f2bc4c14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:05.175 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:05.186+0000 7f2bc4c14780 -1 Falling back to public interface 2026-02-21T12:14:05.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-21T12:14:05.252 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:353: TEST_divergent_ec: sleep 5 2026-02-21T12:14:05.454 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:05.465+0000 7f2bc4c14780 -1 osd.1 30 log_to_monitors true 2026-02-21T12:14:10.253 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:355: TEST_divergent_ec: echo 'delay recovery divergent' 2026-02-21T12:14:10.254 INFO:tasks.workunit.client.0.trial058.stdout:delay recovery divergent 2026-02-21T12:14:10.254 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:356: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:14:10.472 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:14:10.473 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-21T12:13:34.132778+0000 42'102 53:150 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T20:04:55.743939+0000 0 0 2026-02-21T12:14:10.473 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:14:10.473 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:14:10.473 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:14:10.481 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: get_asok_path osd.1 2026-02-21T12:14:10.481 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-21T12:14:10.481 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-21T12:14:10.481 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:14:10.481 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:10.481 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:14:10.481 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.43953/ceph-osd.1.asok 2026-02-21T12:14:10.482 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: CEPH_ARGS= 2026-02-21T12:14:10.482 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.43953/ceph-osd.1.asok set_recovery_delay 100000 2026-02-21T12:14:10.526 INFO:tasks.workunit.client.0.trial058.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-21T12:14:10.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:359: TEST_divergent_ec: ceph osd unset noup 2026-02-21T12:14:10.854 INFO:tasks.workunit.client.0.trial058.stderr:noup is unset 2026-02-21T12:14:10.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:361: TEST_divergent_ec: wait_for_osd up 0 2026-02-21T12:14:10.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:14:10.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:14:10.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:14:10.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:14:10.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:10.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:14:10.866 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:10.867 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:10.867 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:14:11.093 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 45 up_thru 49 down_at 44 last_clean_interval [37,42) [v2:127.0.0.1:6800/941335224,v1:127.0.0.1:6801/941335224] [v2:127.0.0.1:6802/941335224,v1:127.0.0.1:6803/941335224] exists,up e159c710-ae88-4e3c-a6dc-795db09f0a97 2026-02-21T12:14:11.094 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:14:11.095 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:14:11.095 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:14:11.095 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:362: TEST_divergent_ec: wait_for_osd up 1 2026-02-21T12:14:11.095 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:14:11.095 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:14:11.095 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:14:11.095 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:14:11.095 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:11.095 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:14:11.096 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:11.096 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:11.096 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:14:11.320 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 32 last_clean_interval [10,30) [v2:127.0.0.1:6818/1634543114,v1:127.0.0.1:6819/1634543114] [v2:127.0.0.1:6820/1634543114,v1:127.0.0.1:6821/1634543114] exists,up 6e6c6ffe-1b97-4e4f-8540-9377d41393d4 2026-02-21T12:14:11.321 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:14:11.321 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:14:11.321 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:14:11.321 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:363: TEST_divergent_ec: wait_for_osd up 2 2026-02-21T12:14:11.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:14:11.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:14:11.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:14:11.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:14:11.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:11.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:14:11.322 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:11.323 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:11.323 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:14:11.552 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 49 up_thru 0 down_at 48 last_clean_interval [39,42) [v2:127.0.0.1:6810/3549491657,v1:127.0.0.1:6811/3549491657] [v2:127.0.0.1:6812/3549491657,v1:127.0.0.1:6813/3549491657] exists,up ac2b1f6e-5c1b-494b-b046-e94fc885b5ad 2026-02-21T12:14:11.552 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:14:11.553 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:14:11.553 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:14:11.553 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:365: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:14:11.767 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:14:11.767 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-21T12:13:34.132778+0000 42'102 53:150 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T20:04:55.743939+0000 0 0 2026-02-21T12:14:11.767 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:14:11.768 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:14:11.768 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:14:11.774 INFO:tasks.workunit.client.0.trial058.stdout:wait for peering 2026-02-21T12:14:11.774 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:366: TEST_divergent_ec: echo 'wait for peering' 2026-02-21T12:14:11.774 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:367: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:14:11.988 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:14:11.989 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-21T12:13:34.132778+0000 42'102 53:150 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T20:04:55.743939+0000 0 0 2026-02-21T12:14:11.989 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:14:11.989 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:14:11.989 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:14:11.995 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:368: TEST_divergent_ec: rados -p test put foo /tmp/tmp.qfK6uRIW7h 2026-02-21T12:14:12.015 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:369: TEST_divergent_ec: rm -f /tmp/tmp.qfK6uRIW7h 2026-02-21T12:14:12.015 INFO:tasks.workunit.client.0.trial058.stdout:killing divergent 1 2026-02-21T12:14:12.016 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:371: TEST_divergent_ec: echo 'killing divergent 1' 2026-02-21T12:14:12.016 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:372: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:14:12.234 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:14:12.235 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-21T12:13:34.132778+0000 42'102 53:150 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T20:04:55.743939+0000 0 0 2026-02-21T12:14:12.235 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:14:12.235 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:14:12.235 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:14:12.241 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:373: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.1 2026-02-21T12:14:12.242 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:14:12.242 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:14:12.242 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:14:12.242 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:14:12.242 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:14:12.348 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:14:12.348 INFO:tasks.workunit.client.0.trial058.stdout:reviving divergent 1 2026-02-21T12:14:12.349 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:375: TEST_divergent_ec: echo 'reviving divergent 1' 2026-02-21T12:14:12.349 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:376: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:14:12.567 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:14:12.567 INFO:tasks.workunit.client.0.trial058.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-21T12:13:34.132778+0000 42'102 53:150 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T20:04:55.743939+0000 0 0 2026-02-21T12:14:12.567 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:14:12.567 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:14:12.567 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:14:12.574 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:377: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-21T12:14:12.574 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-21T12:14:12.574 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:14:12.574 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-21T12:14:12.574 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:14:12.574 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-21T12:14:12.574 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:14:12.575 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-21T12:14:12.576 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:14:12.577 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f112bd8f-5a4d-4e78-801e-db98a0eb1471 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.43953/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:14:12.577 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-21T12:14:12.577 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-21T12:14:12.578 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:14:12.578 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:14:12.578 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:14:12.595 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:12.606+0000 7f851d9dc780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:12.596 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:12.608+0000 7f851d9dc780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:12.597 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:12.609+0000 7f851d9dc780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:12.735 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:12.746+0000 7f851d9dc780 -1 Falling back to public interface 2026-02-21T12:14:12.808 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-21T12:14:12.808 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:14:12.808 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:14:12.808 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:14:12.809 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:14:12.809 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:12.809 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:14:12.809 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:12.809 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:12.809 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:14:13.039 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 32 last_clean_interval [10,30) [v2:127.0.0.1:6818/1634543114,v1:127.0.0.1:6819/1634543114] [v2:127.0.0.1:6820/1634543114,v1:127.0.0.1:6821/1634543114] exists,up 6e6c6ffe-1b97-4e4f-8540-9377d41393d4 2026-02-21T12:14:13.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:14:13.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:14:13.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:14:13.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:379: TEST_divergent_ec: sleep 20 2026-02-21T12:14:13.102 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:13.113+0000 7f851d9dc780 -1 osd.1 56 log_to_monitors true 2026-02-21T12:14:33.040 INFO:tasks.workunit.client.0.trial058.stdout:allowing recovery 2026-02-21T12:14:33.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:381: TEST_divergent_ec: echo 'allowing recovery' 2026-02-21T12:14:33.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:382: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:14:33.259 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:14:33.259 INFO:tasks.workunit.client.0.trial058.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-21T12:14:13.514750+0000 56'103 60:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T18:36:58.385234+0000 0 0 2026-02-21T12:14:33.259 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:14:33.259 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:14:33.259 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:14:33.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-21T12:14:33.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-21T12:14:33.328 INFO:tasks.workunit.client.0.trial058.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-21T12:14:33.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-21T12:14:33.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-21T12:14:33.395 INFO:tasks.workunit.client.0.trial058.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-21T12:14:33.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-21T12:14:33.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-21T12:14:33.462 INFO:tasks.workunit.client.0.trial058.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-21T12:14:33.468 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:389: TEST_divergent_ec: echo 'reading divergent objects' 2026-02-21T12:14:33.468 INFO:tasks.workunit.client.0.trial058.stdout:reading divergent objects 2026-02-21T12:14:33.469 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: ceph pg dump pgs 2026-02-21T12:14:33.688 INFO:tasks.workunit.client.0.trial058.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-21T12:14:33.688 INFO:tasks.workunit.client.0.trial058.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-21T12:14:13.514750+0000 56'103 60:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-21T12:12:21.983234+0000 0'0 2026-02-21T12:12:21.983234+0000 0 0 periodic scrub scheduled @ 2026-02-22T18:36:58.385234+0000 0 0 2026-02-21T12:14:33.688 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-21T12:14:33.688 INFO:tasks.workunit.client.0.trial058.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-21T12:14:33.688 INFO:tasks.workunit.client.0.trial058.stderr:dumped pgs 2026-02-21T12:14:33.696 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: expr 2 + 2 2026-02-21T12:14:33.697 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: seq 1 4 2026-02-21T12:14:33.698 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:14:33.698 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_1 td/divergent-priors/existing 2026-02-21T12:14:33.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:14:33.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_2 td/divergent-priors/existing 2026-02-21T12:14:33.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:14:33.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_3 td/divergent-priors/existing 2026-02-21T12:14:33.755 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-21T12:14:33.756 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_4 td/divergent-priors/existing 2026-02-21T12:14:33.774 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:395: TEST_divergent_ec: rm -f td/divergent-priors/existing 2026-02-21T12:14:33.775 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-21T12:14:33.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: grep _merge_object_divergent_entries td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:1 entries: 30'103 (29'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-21T12:12:35.949326+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 20 _merge_object_divergent_entries: keeping 30'103 (29'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-21T12:12:35.949326+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version: 29'99 first_divergent_update: 30'103 last_divergent_update: 30'103 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 has no more recent entries in log 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version or op type indicates creation, deleting 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:head entries: 30'104 (29'99) modify 1:7a80c0d5:::existing_99:head by client.4561.0:1 2026-02-21T12:12:40.904167+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 20 _merge_object_divergent_entries: keeping 30'104 (29'99) modify 1:7a80c0d5:::existing_99:head by client.4561.0:1 2026-02-21T12:12:40.904167+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head prior_version: 29'99 first_divergent_update: 30'104 last_divergent_update: 30'104 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head has no more recent entries in log 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head must be rolled back or recovered, attempting to rollback 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head olog_can_rollback_to: 30'104 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot rollback 30'104 (29'99) modify 1:7a80c0d5:::existing_99:head by client.4561.0:1 2026-02-21T12:12:40.904167+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-21T12:14:33.780 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot roll back, removing and adding to missing 2026-02-21T12:14:33.781 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 29'101 (29'100) modify 1:c156033e:::existing_100:head by client.4552.0:1 2026-02-21T12:12:39.829071+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false,29'102 (29'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-21T12:12:40.832865+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:14:33.781 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 20 _merge_object_divergent_entries: keeping 29'101 (29'100) modify 1:c156033e:::existing_100:head by client.4552.0:1 2026-02-21T12:12:39.829071+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:14:33.781 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 20 _merge_object_divergent_entries: keeping 29'102 (29'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-21T12:12:40.832865+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:14:33.781 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-21T12:14:33.781 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 29'100 first_divergent_update: 29'101 last_divergent_update: 29'102 2026-02-21T12:14:33.781 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-21T12:14:33.781 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-21T12:14:33.781 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 30'104 2026-02-21T12:14:33.781 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 29'102 (29'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-21T12:12:40.832865+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-21T12:14:33.781 INFO:tasks.workunit.client.0.trial058.stdout:td/divergent-priors/osd.1.log:2026-02-21T12:14:11.099+0000 7f2ba252f640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-21T12:14:33.781 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-21T12:14:33.782 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: grep -q '_merge_object_divergent_entries.*rolled back' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-21T12:14:33.785 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:411: TEST_divergent_ec: echo success 2026-02-21T12:14:33.785 INFO:tasks.workunit.client.0.trial058.stdout:success 2026-02-21T12:14:33.786 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:413: TEST_divergent_ec: delete_pool test 2026-02-21T12:14:33.786 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-21T12:14:33.786 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-21T12:14:34.058 INFO:tasks.workunit.client.0.trial058.stderr:pool 'test' does not exist 2026-02-21T12:14:34.066 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:414: TEST_divergent_ec: kill_daemons td/divergent-priors 2026-02-21T12:14:34.066 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:14:34.066 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:14:34.067 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:14:34.067 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:14:34.067 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:14:39.381 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:14:39.382 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-21T12:14:39.382 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-21T12:14:39.382 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:14:39.382 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-21T12:14:39.382 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:14:39.382 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:14:39.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:14:39.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:14:39.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:14:39.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:14:39.388 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:14:39.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:14:39.389 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:14:39.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:14:39.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:14:39.390 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:14:39.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:14:39.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:14:39.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:14:39.392 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:14:39.392 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:14:39.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:14:39.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-21T12:14:39.410 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:14:39.410 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:39.410 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:14:39.410 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.43953 2026-02-21T12:14:39.412 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:14:39.412 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:14:39.412 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2429: main: code=0 2026-02-21T12:14:39.412 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2433: main: teardown td/divergent-priors 0 2026-02-21T12:14:39.413 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-21T12:14:39.413 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-21T12:14:39.413 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-21T12:14:39.413 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:14:39.413 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:14:39.413 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:14:39.413 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:14:39.413 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:14:39.414 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:14:39.414 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:14:39.415 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:14:39.415 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:14:39.415 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:14:39.415 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:14:39.416 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:14:39.416 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:14:39.416 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:14:39.417 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:14:39.417 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:14:39.417 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:14:39.418 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-21T12:14:39.418 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-21T12:14:39.419 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:14:39.420 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:39.420 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.43953 2026-02-21T12:14:39.420 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.43953 2026-02-21T12:14:39.421 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:14:39.422 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:14:39.422 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2434: main: return 0 2026-02-21T12:14:39.422 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-21T12:14:39.422 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-21T12:14:39.448 INFO:tasks.workunit:Running workunit osd/ec-error-rollforward.sh... 2026-02-21T12:14:39.449 DEBUG:teuthology.orchestra.run.trial058:workunit test osd/ec-error-rollforward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f7273f3049146bdd7fa7b4a400114872a50228e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2026-02-21T12:14:39.512 INFO:tasks.workunit.client.0.trial058.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2422: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2422: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: main: export PYTHONWARNINGS=ignore 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: main: PYTHONWARNINGS=ignore 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2424: main: export CEPH_CONF=/dev/null 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2424: main: CEPH_CONF=/dev/null 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2425: main: unset CEPH_ARGS 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: main: local code 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2428: main: run td/ec-error-rollforward 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:6: run: local dir=td/ec-error-rollforward 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:7: run: shift 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: export CEPH_MON=127.0.0.1:7132 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: CEPH_MON=127.0.0.1:7132 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:11: run: export CEPH_ARGS 2026-02-21T12:14:39.516 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: uuidgen 2026-02-21T12:14:39.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: CEPH_ARGS+='--fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none ' 2026-02-21T12:14:39.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2026-02-21T12:14:39.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: export margin=10 2026-02-21T12:14:39.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: margin=10 2026-02-21T12:14:39.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: export objects=200 2026-02-21T12:14:39.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: objects=200 2026-02-21T12:14:39.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: export poolname=test 2026-02-21T12:14:39.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: poolname=test 2026-02-21T12:14:39.517 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: set 2026-02-21T12:14:39.517 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: local funcs=TEST_ec_error_rollforward 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:19: run: for func in $funcs 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:20: run: setup td/ec-error-rollforward 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ec-error-rollforward 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ec-error-rollforward 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:14:39.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:14:39.521 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:14:39.521 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:14:39.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:14:39.522 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:14:39.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:14:39.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:14:39.523 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:14:39.524 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:14:39.524 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:14:39.524 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:14:39.524 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:14:39.525 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:14:39.526 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:14:39.526 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-21T12:14:39.527 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:14:39.527 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:39.527 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:39.527 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.98091 2026-02-21T12:14:39.528 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:14:39.528 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:14:39.528 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ec-error-rollforward 2026-02-21T12:14:39.529 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-21T12:14:39.529 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:39.529 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:39.529 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.98091 2026-02-21T12:14:39.530 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-21T12:14:39.530 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-21T12:14:39.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-21T12:14:39.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-21T12:14:39.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ec-error-rollforward 1' TERM HUP INT 2026-02-21T12:14:39.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:21: run: TEST_ec_error_rollforward td/ec-error-rollforward 2026-02-21T12:14:39.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:27: TEST_ec_error_rollforward: local dir=td/ec-error-rollforward 2026-02-21T12:14:39.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:28: TEST_ec_error_rollforward: run_mon td/ec-error-rollforward a 2026-02-21T12:14:39.531 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ec-error-rollforward 2026-02-21T12:14:39.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-21T12:14:39.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-21T12:14:39.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-21T12:14:39.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ec-error-rollforward/a 2026-02-21T12:14:39.532 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ec-error-rollforward/a --run-dir=td/ec-error-rollforward 2026-02-21T12:14:39.549 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-21T12:14:39.549 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:14:39.549 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:14:39.550 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:14:39.550 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:39.550 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:39.550 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:39.550 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ec-error-rollforward/a '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --mon-cluster-log-file=td/ec-error-rollforward/log --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-21T12:14:39.572 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-21T12:14:39.574 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-21T12:14:39.574 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:14:39.574 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:14:39.574 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-21T12:14:39.574 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-21T12:14:39.574 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:14:39.574 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:14:39.574 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:14:39.575 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:14:39.575 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:39.575 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:39.575 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.98091/ceph-mon.a.asok 2026-02-21T12:14:39.575 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:14:39.575 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.98091/ceph-mon.a.asok config get fsid 2026-02-21T12:14:39.619 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-21T12:14:39.619 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:14:39.619 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:14:39.619 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-21T12:14:39.619 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-21T12:14:39.619 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:14:39.620 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:14:39.620 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:14:39.620 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:14:39.620 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:39.620 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:39.620 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.98091/ceph-mon.a.asok 2026-02-21T12:14:39.620 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:14:39.620 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.98091/ceph-mon.a.asok config get mon_host 2026-02-21T12:14:39.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:29: TEST_ec_error_rollforward: run_mgr td/ec-error-rollforward x 2026-02-21T12:14:39.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ec-error-rollforward 2026-02-21T12:14:39.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-21T12:14:39.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-21T12:14:39.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-21T12:14:39.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ec-error-rollforward/x 2026-02-21T12:14:39.664 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-21T12:14:39.761 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-21T12:14:39.761 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:14:39.761 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:14:39.761 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:14:39.761 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:39.761 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:39.761 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:39.761 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:14:39.762 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ec-error-rollforward/x '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:14:39.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:30: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 0 2026-02-21T12:14:39.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-21T12:14:39.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:14:39.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-21T12:14:39.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:14:39.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/0 2026-02-21T12:14:39.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-21T12:14:39.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:14:39.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:14:39.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:14:39.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/0 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=640d16d8-6ae8-44ab-bc28-fc94b97c6f3d 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 640d16d8-6ae8-44ab-bc28-fc94b97c6f3d' 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stdout:add osd0 640d16d8-6ae8-44ab-bc28-fc94b97c6f3d 2026-02-21T12:14:39.778 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:14:39.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCvoZlpO+S1LxAA6Wl2CEXz48QK8Qtf7k9iZA== 2026-02-21T12:14:39.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCvoZlpO+S1LxAA6Wl2CEXz48QK8Qtf7k9iZA=="}' 2026-02-21T12:14:39.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 640d16d8-6ae8-44ab-bc28-fc94b97c6f3d -i td/ec-error-rollforward/0/new.json 2026-02-21T12:14:39.889 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:39.895 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/0/new.json 2026-02-21T12:14:39.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCvoZlpO+S1LxAA6Wl2CEXz48QK8Qtf7k9iZA== --osd-uuid 640d16d8-6ae8-44ab-bc28-fc94b97c6f3d 2026-02-21T12:14:39.911 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:39.922+0000 7f2ad003a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:39.912 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:39.923+0000 7f2ad003a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:39.913 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:39.924+0000 7f2ad003a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:39.914 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:39.924+0000 7f2ad003a780 -1 bdev(0x3492c00 td/ec-error-rollforward/0/block) open stat got: (1) Operation not permitted 2026-02-21T12:14:39.914 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:39.924+0000 7f2ad003a780 -1 bluestore(td/ec-error-rollforward/0) _read_fsid unparsable uuid 2026-02-21T12:14:40.308 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/0/keyring 2026-02-21T12:14:40.309 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:14:40.309 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-21T12:14:40.309 INFO:tasks.workunit.client.0.trial058.stdout:adding osd0 key to auth repository 2026-02-21T12:14:40.310 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:14:40.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-21T12:14:40.411 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:14:40.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:14:40.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:14:40.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:14:40.411 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:14:40.424 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:40.435+0000 7f69ce5e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:40.425 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:40.436+0000 7f69ce5e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:40.426 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:40.437+0000 7f69ce5e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:40.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-21T12:14:40.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:14:40.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:14:40.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:14:40.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:14:40.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:40.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:14:40.509 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:40.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:40.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:14:40.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:14:40.671 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:40.681+0000 7f69ce5e3780 -1 Falling back to public interface 2026-02-21T12:14:41.047 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:41.057+0000 7f69ce5e3780 -1 osd.0 0 log_to_monitors true 2026-02-21T12:14:41.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:14:41.605 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:41.606 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:14:41.607 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:14:41.607 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:41.607 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:14:41.698 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1832780842,v1:127.0.0.1:6801/1832780842] [v2:127.0.0.1:6802/1832780842,v1:127.0.0.1:6803/1832780842] exists,up 640d16d8-6ae8-44ab-bc28-fc94b97c6f3d 2026-02-21T12:14:41.703 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:14:41.703 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:14:41.703 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:14:41.703 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:31: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 1 2026-02-21T12:14:41.703 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-21T12:14:41.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:14:41.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-21T12:14:41.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:14:41.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/1 2026-02-21T12:14:41.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-21T12:14:41.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:14:41.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:14:41.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:14:41.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-21T12:14:41.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-21T12:14:41.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:14:41.705 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:14:41.705 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-21T12:14:41.705 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:14:41.705 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:14:41.705 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:14:41.705 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:14:41.705 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:41.705 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:41.705 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:41.705 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:41.705 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:14:41.706 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:14:41.706 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:14:41.706 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-21T12:14:41.706 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-21T12:14:41.706 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:14:41.706 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:14:41.706 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:14:41.706 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:14:41.706 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:14:41.706 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:14:41.707 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/1 2026-02-21T12:14:41.707 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:14:41.707 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b2ef0319-271e-47b9-8442-287d3f4855bc 2026-02-21T12:14:41.707 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b2ef0319-271e-47b9-8442-287d3f4855bc' 2026-02-21T12:14:41.707 INFO:tasks.workunit.client.0.trial058.stdout:add osd1 b2ef0319-271e-47b9-8442-287d3f4855bc 2026-02-21T12:14:41.708 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:14:41.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCxoZlpR08JKxAAv7GmSRCT9eYt9cejE2bdAA== 2026-02-21T12:14:41.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCxoZlpR08JKxAAv7GmSRCT9eYt9cejE2bdAA=="}' 2026-02-21T12:14:41.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b2ef0319-271e-47b9-8442-287d3f4855bc -i td/ec-error-rollforward/1/new.json 2026-02-21T12:14:41.814 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:14:41.820 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/1/new.json 2026-02-21T12:14:41.821 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCxoZlpR08JKxAAv7GmSRCT9eYt9cejE2bdAA== --osd-uuid b2ef0319-271e-47b9-8442-287d3f4855bc 2026-02-21T12:14:41.834 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:41.845+0000 7f3e94e41780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:41.836 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:41.847+0000 7f3e94e41780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:41.837 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:41.848+0000 7f3e94e41780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:41.837 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:41.848+0000 7f3e94e41780 -1 bdev(0x4166c00 td/ec-error-rollforward/1/block) open stat got: (1) Operation not permitted 2026-02-21T12:14:41.837 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:41.848+0000 7f3e94e41780 -1 bluestore(td/ec-error-rollforward/1) _read_fsid unparsable uuid 2026-02-21T12:14:42.158 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/1/keyring 2026-02-21T12:14:42.159 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:14:42.159 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-21T12:14:42.159 INFO:tasks.workunit.client.0.trial058.stdout:adding osd1 key to auth repository 2026-02-21T12:14:42.159 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:14:42.470 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-21T12:14:42.471 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:14:42.472 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:14:42.472 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:14:42.472 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:14:42.472 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:14:42.482 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:42.493+0000 7f3d37022780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:42.484 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:42.494+0000 7f3d37022780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:42.484 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:42.495+0000 7f3d37022780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:42.609 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:42.620+0000 7f3d37022780 -1 Falling back to public interface 2026-02-21T12:14:42.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-21T12:14:42.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:14:42.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:14:42.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:14:42.695 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:14:42.696 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:42.696 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:42.696 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:14:42.696 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:42.696 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:14:42.898 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:42.908+0000 7f3d37022780 -1 osd.1 0 log_to_monitors true 2026-02-21T12:14:42.926 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:14:43.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:14:43.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:43.928 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:14:43.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:14:43.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:43.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:14:44.149 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1747754294,v1:127.0.0.1:6811/1747754294] [v2:127.0.0.1:6812/1747754294,v1:127.0.0.1:6813/1747754294] exists,up b2ef0319-271e-47b9-8442-287d3f4855bc 2026-02-21T12:14:44.152 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:14:44.152 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:14:44.152 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:14:44.153 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:32: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 2 2026-02-21T12:14:44.153 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-21T12:14:44.153 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:14:44.153 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-21T12:14:44.153 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:14:44.153 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/2 2026-02-21T12:14:44.153 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-21T12:14:44.153 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:14:44.153 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:14:44.153 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:14:44.153 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-21T12:14:44.153 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-21T12:14:44.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:14:44.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:14:44.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-21T12:14:44.154 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:14:44.154 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:14:44.154 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:14:44.154 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:14:44.154 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:44.154 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:44.154 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:44.154 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/2 2026-02-21T12:14:44.155 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:14:44.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3ff6b668-4596-4426-a702-59c99c2c54f6 2026-02-21T12:14:44.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 3ff6b668-4596-4426-a702-59c99c2c54f6' 2026-02-21T12:14:44.156 INFO:tasks.workunit.client.0.trial058.stdout:add osd2 3ff6b668-4596-4426-a702-59c99c2c54f6 2026-02-21T12:14:44.156 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:14:44.161 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC0oZlpg8FNChAAJEA+mw+OXID9fa7ItEH2Og== 2026-02-21T12:14:44.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC0oZlpg8FNChAAJEA+mw+OXID9fa7ItEH2Og=="}' 2026-02-21T12:14:44.162 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3ff6b668-4596-4426-a702-59c99c2c54f6 -i td/ec-error-rollforward/2/new.json 2026-02-21T12:14:44.394 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:14:44.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/2/new.json 2026-02-21T12:14:44.402 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC0oZlpg8FNChAAJEA+mw+OXID9fa7ItEH2Og== --osd-uuid 3ff6b668-4596-4426-a702-59c99c2c54f6 2026-02-21T12:14:44.417 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:44.428+0000 7ff1dd06f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:44.418 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:44.430+0000 7ff1dd06f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:44.419 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:44.431+0000 7ff1dd06f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:44.419 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:44.431+0000 7ff1dd06f780 -1 bdev(0x43e6c00 td/ec-error-rollforward/2/block) open stat got: (1) Operation not permitted 2026-02-21T12:14:44.419 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:44.431+0000 7ff1dd06f780 -1 bluestore(td/ec-error-rollforward/2) _read_fsid unparsable uuid 2026-02-21T12:14:44.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/2/keyring 2026-02-21T12:14:44.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:14:44.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-21T12:14:44.762 INFO:tasks.workunit.client.0.trial058.stdout:adding osd2 key to auth repository 2026-02-21T12:14:44.762 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:14:45.076 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-21T12:14:45.076 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:14:45.076 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:14:45.076 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:14:45.076 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:14:45.076 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:14:45.089 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:45.100+0000 7f4e7f408780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:45.090 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:45.102+0000 7f4e7f408780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:45.091 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:45.103+0000 7f4e7f408780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:45.247 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:45.259+0000 7f4e7f408780 -1 Falling back to public interface 2026-02-21T12:14:45.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-21T12:14:45.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:14:45.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:14:45.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:14:45.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:14:45.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:45.298 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:45.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:14:45.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:45.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:14:45.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:14:45.551 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:45.562+0000 7f4e7f408780 -1 osd.2 0 log_to_monitors true 2026-02-21T12:14:46.524 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:14:46.525 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:46.525 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:14:46.525 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:14:46.525 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:46.525 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:14:46.746 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1531782157,v1:127.0.0.1:6819/1531782157] [v2:127.0.0.1:6820/1531782157,v1:127.0.0.1:6821/1531782157] exists,up 3ff6b668-4596-4426-a702-59c99c2c54f6 2026-02-21T12:14:46.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:33: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 3 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/3 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:14:46.748 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:14:46.749 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:14:46.749 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:46.749 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:46.749 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/3 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=552e9813-5196-44b4-be24-e70de310af83 2026-02-21T12:14:46.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 552e9813-5196-44b4-be24-e70de310af83' 2026-02-21T12:14:46.751 INFO:tasks.workunit.client.0.trial058.stdout:add osd3 552e9813-5196-44b4-be24-e70de310af83 2026-02-21T12:14:46.751 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:14:46.760 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC2oZlpUmkFLhAApzMteJiAKh3Xl2Y/0VYboA== 2026-02-21T12:14:46.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC2oZlpUmkFLhAApzMteJiAKh3Xl2Y/0VYboA=="}' 2026-02-21T12:14:46.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 552e9813-5196-44b4-be24-e70de310af83 -i td/ec-error-rollforward/3/new.json 2026-02-21T12:14:46.987 INFO:tasks.workunit.client.0.trial058.stdout:3 2026-02-21T12:14:46.994 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/3/new.json 2026-02-21T12:14:46.995 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC2oZlpUmkFLhAApzMteJiAKh3Xl2Y/0VYboA== --osd-uuid 552e9813-5196-44b4-be24-e70de310af83 2026-02-21T12:14:47.009 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:47.020+0000 7f387b20b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:47.010 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:47.022+0000 7f387b20b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:47.011 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:47.022+0000 7f387b20b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:47.011 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:47.023+0000 7f387b20b780 -1 bdev(0x2984c00 td/ec-error-rollforward/3/block) open stat got: (1) Operation not permitted 2026-02-21T12:14:47.012 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:47.023+0000 7f387b20b780 -1 bluestore(td/ec-error-rollforward/3) _read_fsid unparsable uuid 2026-02-21T12:14:47.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/3/keyring 2026-02-21T12:14:47.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:14:47.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-21T12:14:47.331 INFO:tasks.workunit.client.0.trial058.stdout:adding osd3 key to auth repository 2026-02-21T12:14:47.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:14:47.650 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-21T12:14:47.651 INFO:tasks.workunit.client.0.trial058.stdout:start osd.3 2026-02-21T12:14:47.651 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:14:47.652 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:14:47.652 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:14:47.652 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:14:47.663 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:47.674+0000 7f66e283d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:47.664 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:47.676+0000 7f66e283d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:47.665 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:47.677+0000 7f66e283d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:47.837 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:47.848+0000 7f66e283d780 -1 Falling back to public interface 2026-02-21T12:14:47.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-21T12:14:47.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:14:47.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-21T12:14:47.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:14:47.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:14:47.873 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:47.873 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:14:47.873 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:47.874 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:47.874 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:14:48.103 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:14:48.132 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:48.143+0000 7f66e283d780 -1 osd.3 0 log_to_monitors true 2026-02-21T12:14:49.104 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:14:49.105 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:49.105 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:14:49.105 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:14:49.105 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:49.105 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:14:49.329 INFO:tasks.workunit.client.0.trial058.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3605218235,v1:127.0.0.1:6827/3605218235] [v2:127.0.0.1:6828/3605218235,v1:127.0.0.1:6829/3605218235] exists,up 552e9813-5196-44b4-be24-e70de310af83 2026-02-21T12:14:49.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:14:49.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:14:49.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:14:49.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:35: TEST_ec_error_rollforward: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-21T12:14:49.610 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:36: TEST_ec_error_rollforward: ceph osd pool create ec 1 1 erasure ec-profile 2026-02-21T12:14:49.980 INFO:tasks.workunit.client.0.trial058.stderr:pool 'ec' already exists 2026-02-21T12:14:49.988 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:38: TEST_ec_error_rollforward: rados -p ec put foo /etc/passwd 2026-02-21T12:14:50.156 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: cat td/ec-error-rollforward/osd.2.pid 2026-02-21T12:14:50.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: kill -STOP 102098 2026-02-21T12:14:50.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:43: TEST_ec_error_rollforward: pids=104191 2026-02-21T12:14:50.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:44: TEST_ec_error_rollforward: sleep 1 2026-02-21T12:14:50.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:42: TEST_ec_error_rollforward: rados -p ec rm foo 2026-02-21T12:14:51.159 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:46: TEST_ec_error_rollforward: pids+=' 104212' 2026-02-21T12:14:51.159 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:45: TEST_ec_error_rollforward: rados -p ec rm a 2026-02-21T12:14:51.159 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:48: TEST_ec_error_rollforward: pids+=' 104213' 2026-02-21T12:14:51.159 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:47: TEST_ec_error_rollforward: rados -p ec rm b 2026-02-21T12:14:51.159 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:50: TEST_ec_error_rollforward: pids+=' 104214' 2026-02-21T12:14:51.160 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:51: TEST_ec_error_rollforward: sleep 1 2026-02-21T12:14:51.160 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:49: TEST_ec_error_rollforward: rados -p ec rm c 2026-02-21T12:14:52.160 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:54: TEST_ec_error_rollforward: kill_daemons td/ec-error-rollforward KILL osd 2026-02-21T12:14:52.161 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:14:52.161 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:14:52.161 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:14:52.161 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:14:52.161 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:14:52.270 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:14:52.270 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:55: TEST_ec_error_rollforward: kill 104191 104212 104213 104214 2026-02-21T12:14:52.270 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:56: TEST_ec_error_rollforward: wait 2026-02-21T12:14:52.273 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:58: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 0 2026-02-21T12:14:52.273 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/0 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-21T12:14:52.274 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:14:52.275 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:14:52.276 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/0 2026-02-21T12:14:52.276 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-21T12:14:52.276 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:14:52.277 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:14:52.277 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/0/whoami 2026-02-21T12:14:52.277 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-21T12:14:52.277 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:14:52.277 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:14:52.277 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:14:52.287 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:52.298+0000 7f34b3627780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:52.288 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:52.300+0000 7f34b3627780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:52.289 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:52.300+0000 7f34b3627780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:52.458 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:52.469+0000 7f34b3627780 -1 Falling back to public interface 2026-02-21T12:14:52.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-21T12:14:52.501 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:14:52.501 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:14:52.501 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:14:52.501 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:14:52.501 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:52.501 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:14:52.502 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:52.503 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:52.503 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:14:52.724 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1832780842,v1:127.0.0.1:6801/1832780842] [v2:127.0.0.1:6802/1832780842,v1:127.0.0.1:6803/1832780842] exists,up 640d16d8-6ae8-44ab-bc28-fc94b97c6f3d 2026-02-21T12:14:52.727 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:14:52.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:14:52.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:14:52.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:59: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 1 2026-02-21T12:14:52.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-21T12:14:52.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:14:52.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-21T12:14:52.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:14:52.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/1 2026-02-21T12:14:52.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-21T12:14:52.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:14:52.729 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:14:52.729 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:14:52.729 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-21T12:14:52.729 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-21T12:14:52.729 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:14:52.729 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:14:52.729 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-21T12:14:52.729 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:14:52.729 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:14:52.729 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:14:52.729 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:14:52.729 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:14:52.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/1 2026-02-21T12:14:52.731 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:14:52.732 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-21T12:14:52.732 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:14:52.732 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/1/whoami 2026-02-21T12:14:52.732 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-21T12:14:52.732 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:14:52.732 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:14:52.732 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:14:52.739 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:52.750+0000 7f899da72780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:52.740 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:52.752+0000 7f899da72780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:52.741 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:52.752+0000 7f899da72780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:52.772 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:52.783+0000 7f34b3627780 -1 osd.0 24 log_to_monitors true 2026-02-21T12:14:52.875 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:52.887+0000 7f899da72780 -1 Falling back to public interface 2026-02-21T12:14:52.951 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-21T12:14:52.951 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:14:52.951 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:14:52.951 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:14:52.951 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:14:52.951 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:52.952 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:52.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:14:52.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:52.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:14:53.173 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 10 up_thru 22 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1747754294,v1:127.0.0.1:6811/1747754294] [v2:127.0.0.1:6812/1747754294,v1:127.0.0.1:6813/1747754294] exists,up b2ef0319-271e-47b9-8442-287d3f4855bc 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:60: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 2 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/2 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:14:53.174 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/2 2026-02-21T12:14:53.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-21T12:14:53.176 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:14:53.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:14:53.176 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/2/whoami 2026-02-21T12:14:53.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-21T12:14:53.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:14:53.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:14:53.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:14:53.187 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:53.199+0000 7ff63cc2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:53.189 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:53.201+0000 7ff63cc2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:53.190 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:53.202+0000 7ff63cc2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:53.307 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:53.318+0000 7f899da72780 -1 osd.1 24 log_to_monitors true 2026-02-21T12:14:53.384 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:53.395+0000 7ff63cc2d780 -1 Falling back to public interface 2026-02-21T12:14:53.408 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-21T12:14:53.408 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:14:53.408 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:14:53.408 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:14:53.408 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:14:53.408 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:53.408 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:14:53.409 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:53.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:53.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:14:53.632 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:14:53.682 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:53.694+0000 7ff63cc2d780 -1 osd.2 23 log_to_monitors true 2026-02-21T12:14:54.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:14:54.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:54.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:14:54.633 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:14:54.634 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:54.634 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:14:54.861 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 34 up_thru 0 down_at 28 last_clean_interval [14,23) [v2:127.0.0.1:6818/4060418644,v1:127.0.0.1:6819/4060418644] [v2:127.0.0.1:6820/4060418644,v1:127.0.0.1:6821/4060418644] exists,up 3ff6b668-4596-4426-a702-59c99c2c54f6 2026-02-21T12:14:54.863 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:14:54.863 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:14:54.863 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:61: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 3 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/3 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:14:54.864 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/3 2026-02-21T12:14:54.865 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-21T12:14:54.866 INFO:tasks.workunit.client.0.trial058.stdout:start osd.3 2026-02-21T12:14:54.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=cee4ada8-bd6b-4c3f-ae2a-bed75a54f40c --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98091/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:14:54.866 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/3/whoami 2026-02-21T12:14:54.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-21T12:14:54.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:14:54.867 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:14:54.867 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:14:54.877 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:54.888+0000 7f9cea638780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:54.878 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:54.890+0000 7f9cea638780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:54.879 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:54.890+0000 7f9cea638780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:14:55.019 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:55.031+0000 7f9cea638780 -1 Falling back to public interface 2026-02-21T12:14:55.089 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-21T12:14:55.089 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:14:55.089 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-21T12:14:55.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:14:55.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:14:55.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:55.090 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:14:55.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:14:55.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:55.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:14:55.313 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:14:55.371 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:14:55.383+0000 7f9cea638780 -1 osd.3 24 log_to_monitors true 2026-02-21T12:14:56.314 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:14:56.314 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:14:56.314 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:14:56.314 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:14:56.314 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:14:56.315 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:14:56.536 INFO:tasks.workunit.client.0.trial058.stdout:osd.3 up in weight 1 up_from 39 up_thru 0 down_at 28 last_clean_interval [18,24) [v2:127.0.0.1:6826/1696576870,v1:127.0.0.1:6827/1696576870] [v2:127.0.0.1:6828/1696576870,v1:127.0.0.1:6829/1696576870] exists,up 552e9813-5196-44b4-be24-e70de310af83 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:63: TEST_ec_error_rollforward: wait_for_clean 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:14:56.537 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:14:56.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-21T12:14:56.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:14:56.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:14:56.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:14:56.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:14:56.621 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:14:56.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:14:56.843 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:14:56.843 INFO:tasks.workunit.client.0.trial058.stderr:2 2026-02-21T12:14:56.843 INFO:tasks.workunit.client.0.trial058.stderr:3' 2026-02-21T12:14:56.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:14:56.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:14:56.843 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:14:56.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=115964116995 2026-02-21T12:14:56.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 115964116995 2026-02-21T12:14:56.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-115964116995' 2026-02-21T12:14:56.908 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:14:56.908 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:14:56.970 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=133143986179 2026-02-21T12:14:56.970 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 133143986179 2026-02-21T12:14:56.970 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-115964116995 1-133143986179' 2026-02-21T12:14:56.970 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:14:56.970 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:14:57.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=146028888067 2026-02-21T12:14:57.036 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 146028888067 2026-02-21T12:14:57.036 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-115964116995 1-133143986179 2-146028888067' 2026-02-21T12:14:57.036 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:14:57.036 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-21T12:14:57.097 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=167503724547 2026-02-21T12:14:57.097 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 167503724547 2026-02-21T12:14:57.097 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-115964116995 1-133143986179 2-146028888067 3-167503724547' 2026-02-21T12:14:57.097 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:14:57.098 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-115964116995 2026-02-21T12:14:57.098 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:14:57.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:14:57.099 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-115964116995 2026-02-21T12:14:57.099 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:14:57.100 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=115964116995 2026-02-21T12:14:57.100 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 115964116995' 2026-02-21T12:14:57.100 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 115964116995 2026-02-21T12:14:57.101 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:14:57.327 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 1 -lt 115964116995 2026-02-21T12:14:57.327 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:14:58.328 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:14:58.328 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:14:58.550 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 115964116995 -lt 115964116995 2026-02-21T12:14:58.551 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:14:58.551 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-133143986179 2026-02-21T12:14:58.552 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:14:58.552 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:14:58.553 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-133143986179 2026-02-21T12:14:58.553 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:14:58.554 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=133143986179 2026-02-21T12:14:58.554 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 133143986179 2026-02-21T12:14:58.555 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 133143986179' 2026-02-21T12:14:58.555 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:14:58.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 133143986179 -lt 133143986179 2026-02-21T12:14:58.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:14:58.778 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-146028888067 2026-02-21T12:14:58.778 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:14:58.779 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:14:58.779 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-146028888067 2026-02-21T12:14:58.779 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:14:58.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=146028888067 2026-02-21T12:14:58.780 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 146028888067 2026-02-21T12:14:58.781 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 146028888067' 2026-02-21T12:14:58.781 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:14:59.004 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 146028888067 -lt 146028888067 2026-02-21T12:14:59.005 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:14:59.005 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 3-167503724547 2026-02-21T12:14:59.006 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:14:59.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=3 2026-02-21T12:14:59.007 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 3-167503724547 2026-02-21T12:14:59.007 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:14:59.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=167503724547 2026-02-21T12:14:59.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.3 seq 167503724547' 2026-02-21T12:14:59.009 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.3 seq 167503724547 2026-02-21T12:14:59.009 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-21T12:14:59.234 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 167503724547 -lt 167503724547 2026-02-21T12:14:59.235 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:14:59.235 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:14:59.235 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:14:59.550 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-21T12:14:59.550 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:14:59.550 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:14:59.551 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:14:59.551 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:14:59.551 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:14:59.551 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:14:59.551 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:14:59.773 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-21T12:14:59.774 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:14:59.774 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:14:59.774 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:15:00.082 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-21T12:15:00.083 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:15:00.083 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:15:00.083 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:22: run: teardown td/ec-error-rollforward 2026-02-21T12:15:00.083 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-21T12:15:00.083 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:15:00.083 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-21T12:15:00.083 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:15:00.083 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:15:00.083 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:15:00.083 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:15:00.084 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:15:00.190 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:15:00.191 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:15:00.191 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:15:00.192 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:15:00.193 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:15:00.193 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:15:00.194 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:15:00.195 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:15:00.195 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:15:00.195 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:15:00.195 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:15:00.196 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:15:00.197 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:15:00.197 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-21T12:15:00.206 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:15:00.206 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:00.206 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:15:00.206 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.98091 2026-02-21T12:15:00.208 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:15:00.208 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:15:00.208 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2429: main: code=0 2026-02-21T12:15:00.208 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2433: main: teardown td/ec-error-rollforward 0 2026-02-21T12:15:00.208 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-21T12:15:00.208 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-21T12:15:00.208 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-21T12:15:00.208 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:15:00.208 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:15:00.208 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:15:00.209 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:15:00.209 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:15:00.209 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:15:00.209 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:15:00.210 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:15:00.210 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:15:00.211 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:15:00.211 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:15:00.212 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:15:00.212 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:15:00.212 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:15:00.213 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:15:00.213 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:15:00.213 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:15:00.214 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-21T12:15:00.214 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-21T12:15:00.215 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:15:00.216 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:00.216 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98091 2026-02-21T12:15:00.216 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.98091 2026-02-21T12:15:00.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:15:00.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:15:00.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2434: main: return 0 2026-02-21T12:15:00.218 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-21T12:15:00.218 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-21T12:15:00.284 INFO:tasks.workunit:Running workunit osd/osd-bench.sh... 2026-02-21T12:15:00.284 DEBUG:teuthology.orchestra.run.trial058:workunit test osd/osd-bench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f7273f3049146bdd7fa7b4a400114872a50228e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2026-02-21T12:15:00.348 INFO:tasks.workunit.client.0.trial058.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-21T12:15:00.352 INFO:tasks.workunit.client.0.trial058.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-21T12:15:00.353 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2422: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-21T12:15:00.353 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2422: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-21T12:15:00.353 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: main: export PYTHONWARNINGS=ignore 2026-02-21T12:15:00.353 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: main: PYTHONWARNINGS=ignore 2026-02-21T12:15:00.353 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2424: main: export CEPH_CONF=/dev/null 2026-02-21T12:15:00.353 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2424: main: CEPH_CONF=/dev/null 2026-02-21T12:15:00.353 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2425: main: unset CEPH_ARGS 2026-02-21T12:15:00.353 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: main: local code 2026-02-21T12:15:00.353 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2428: main: run td/osd-bench 2026-02-21T12:15:00.353 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:22: run: local dir=td/osd-bench 2026-02-21T12:15:00.353 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:23: run: shift 2026-02-21T12:15:00.354 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: export CEPH_MON=127.0.0.1:7106 2026-02-21T12:15:00.354 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: CEPH_MON=127.0.0.1:7106 2026-02-21T12:15:00.354 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:26: run: export CEPH_ARGS 2026-02-21T12:15:00.354 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: uuidgen 2026-02-21T12:15:00.354 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: CEPH_ARGS+='--fsid=3d741684-955b-474d-beaa-bfedbfcdd5c9 --auth-supported=none ' 2026-02-21T12:15:00.354 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7106 ' 2026-02-21T12:15:00.354 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:29: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-21T12:15:00.354 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: set 2026-02-21T12:15:00.354 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-21T12:15:00.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: local funcs=TEST_bench 2026-02-21T12:15:00.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:32: run: for func in $funcs 2026-02-21T12:15:00.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:33: run: setup td/osd-bench 2026-02-21T12:15:00.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bench 2026-02-21T12:15:00.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bench 2026-02-21T12:15:00.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-21T12:15:00.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:15:00.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-21T12:15:00.356 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:15:00.357 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:15:00.357 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:15:00.357 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:15:00.357 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:15:00.357 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:15:00.358 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:15:00.358 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:15:00.358 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:15:00.358 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:15:00.358 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:15:00.359 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:15:00.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:15:00.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:15:00.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:15:00.360 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:15:00.360 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:15:00.361 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:15:00.361 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-21T12:15:00.362 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:15:00.362 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:00.362 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.106920 2026-02-21T12:15:00.362 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.106920 2026-02-21T12:15:00.363 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:15:00.363 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:15:00.363 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bench 2026-02-21T12:15:00.364 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-21T12:15:00.364 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:00.364 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.106920 2026-02-21T12:15:00.364 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.106920 2026-02-21T12:15:00.365 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-21T12:15:00.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-21T12:15:00.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-21T12:15:00.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-21T12:15:00.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bench 1' TERM HUP INT 2026-02-21T12:15:00.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:34: run: TEST_bench td/osd-bench 2026-02-21T12:15:00.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:40: TEST_bench: local dir=td/osd-bench 2026-02-21T12:15:00.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:42: TEST_bench: run_mon td/osd-bench a 2026-02-21T12:15:00.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bench 2026-02-21T12:15:00.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-21T12:15:00.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-21T12:15:00.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-21T12:15:00.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bench/a 2026-02-21T12:15:00.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bench/a --run-dir=td/osd-bench 2026-02-21T12:15:00.383 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-21T12:15:00.383 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:15:00.383 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:15:00.383 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:15:00.383 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:00.383 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.106920 2026-02-21T12:15:00.383 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.106920/$cluster-$name.asok' 2026-02-21T12:15:00.383 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bench/a '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.106920/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bench/log --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-21T12:15:00.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-21T12:15:00.406 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-21T12:15:00.406 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:15:00.407 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:15:00.407 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-21T12:15:00.408 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-21T12:15:00.408 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:15:00.408 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:15:00.408 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:15:00.408 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:15:00.408 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:00.408 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.106920 2026-02-21T12:15:00.409 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.106920/ceph-mon.a.asok 2026-02-21T12:15:00.409 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:15:00.409 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.106920/ceph-mon.a.asok config get fsid 2026-02-21T12:15:00.451 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-21T12:15:00.452 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:15:00.452 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:15:00.452 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-21T12:15:00.452 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-21T12:15:00.452 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:15:00.452 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:15:00.452 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:15:00.452 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:15:00.452 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:00.452 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.106920 2026-02-21T12:15:00.452 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.106920/ceph-mon.a.asok 2026-02-21T12:15:00.452 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:15:00.453 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.106920/ceph-mon.a.asok config get mon_host 2026-02-21T12:15:00.496 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:43: TEST_bench: run_mgr td/osd-bench x 2026-02-21T12:15:00.496 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bench 2026-02-21T12:15:00.496 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-21T12:15:00.496 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-21T12:15:00.496 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-21T12:15:00.497 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bench/x 2026-02-21T12:15:00.497 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-21T12:15:00.592 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-21T12:15:00.592 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:15:00.592 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:15:00.593 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:15:00.593 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:00.593 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.106920 2026-02-21T12:15:00.593 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.106920/$cluster-$name.asok' 2026-02-21T12:15:00.593 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:15:00.594 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bench/x '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.106920/$cluster-$name.asok' --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:15:00.612 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:44: TEST_bench: run_osd td/osd-bench 0 2026-02-21T12:15:00.612 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bench 2026-02-21T12:15:00.612 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:15:00.612 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-21T12:15:00.612 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:15:00.612 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bench/0 2026-02-21T12:15:00.612 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=3d741684-955b-474d-beaa-bfedbfcdd5c9 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 ' 2026-02-21T12:15:00.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:15:00.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:15:00.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:15:00.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bench/0' 2026-02-21T12:15:00.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bench/0/journal' 2026-02-21T12:15:00.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:15:00.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:15:00.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bench' 2026-02-21T12:15:00.613 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:15:00.613 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:15:00.613 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:15:00.613 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:15:00.614 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:00.614 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.106920 2026-02-21T12:15:00.614 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.106920/$cluster-$name.asok' 2026-02-21T12:15:00.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.106920/$cluster-$name.asok' 2026-02-21T12:15:00.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:15:00.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:15:00.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:15:00.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bench/$name.log' 2026-02-21T12:15:00.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bench/$name.pid' 2026-02-21T12:15:00.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:15:00.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:15:00.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:15:00.615 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:15:00.615 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:15:00.615 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:15:00.615 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bench/0 2026-02-21T12:15:00.615 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:15:00.615 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=05be3e0a-2417-42e4-940a-1731215d1368 2026-02-21T12:15:00.615 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 05be3e0a-2417-42e4-940a-1731215d1368' 2026-02-21T12:15:00.615 INFO:tasks.workunit.client.0.trial058.stdout:add osd0 05be3e0a-2417-42e4-940a-1731215d1368 2026-02-21T12:15:00.616 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:15:00.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDEoZlpxnmjJRAAQfojWsh/wlC+ZOzHA1Bmjw== 2026-02-21T12:15:00.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDEoZlpxnmjJRAAQfojWsh/wlC+ZOzHA1Bmjw=="}' 2026-02-21T12:15:00.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 05be3e0a-2417-42e4-940a-1731215d1368 -i td/osd-bench/0/new.json 2026-02-21T12:15:00.721 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:15:00.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bench/0/new.json 2026-02-21T12:15:00.729 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=3d741684-955b-474d-beaa-bfedbfcdd5c9 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.106920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDEoZlpxnmjJRAAQfojWsh/wlC+ZOzHA1Bmjw== --osd-uuid 05be3e0a-2417-42e4-940a-1731215d1368 2026-02-21T12:15:00.745 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:00.756+0000 7fcd7d460780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:00.746 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:00.758+0000 7fcd7d460780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:00.747 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:00.759+0000 7fcd7d460780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:00.747 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:00.759+0000 7fcd7d460780 -1 bdev(0x4116c00 td/osd-bench/0/block) open stat got: (1) Operation not permitted 2026-02-21T12:15:00.748 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:00.759+0000 7fcd7d460780 -1 bluestore(td/osd-bench/0) _read_fsid unparsable uuid 2026-02-21T12:15:01.195 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bench/0/keyring 2026-02-21T12:15:01.196 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:15:01.196 INFO:tasks.workunit.client.0.trial058.stdout:adding osd0 key to auth repository 2026-02-21T12:15:01.197 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-21T12:15:01.197 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bench/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:15:01.297 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:15:01.297 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-21T12:15:01.297 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=3d741684-955b-474d-beaa-bfedbfcdd5c9 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.106920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:15:01.297 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:15:01.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:15:01.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:15:01.310 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:01.321+0000 7f21d9444780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:01.311 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:01.323+0000 7f21d9444780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:01.312 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:01.324+0000 7f21d9444780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:01.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-21T12:15:01.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:15:01.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:15:01.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:15:01.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:15:01.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:15:01.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:15:01.395 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:15:01.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:15:01.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:15:01.489 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:15:01.525 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:01.537+0000 7f21d9444780 -1 Falling back to public interface 2026-02-21T12:15:01.839 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:01.850+0000 7f21d9444780 -1 osd.0 0 log_to_monitors true 2026-02-21T12:15:02.490 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:15:02.490 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:15:02.491 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:15:02.491 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:15:02.491 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:15:02.491 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:15:02.586 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1307002706,v1:127.0.0.1:6801/1307002706] [v2:127.0.0.1:6802/1307002706,v1:127.0.0.1:6803/1307002706] exists,up 05be3e0a-2417-42e4-940a-1731215d1368 2026-02-21T12:15:02.588 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:15:02.589 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:15:02.589 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:15:02.590 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: CEPH_ARGS= 2026-02-21T12:15:02.591 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: ceph-conf --show-config-value osd_bench_small_size_max_iops 2026-02-21T12:15:02.593 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: local osd_bench_small_size_max_iops=100 2026-02-21T12:15:02.593 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: CEPH_ARGS= 2026-02-21T12:15:02.594 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: ceph-conf --show-config-value osd_bench_large_size_max_throughput 2026-02-21T12:15:02.599 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: local osd_bench_large_size_max_throughput=104857600 2026-02-21T12:15:02.600 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: CEPH_ARGS= 2026-02-21T12:15:02.600 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: ceph-conf --show-config-value osd_bench_max_block_size 2026-02-21T12:15:02.608 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: local osd_bench_max_block_size=67108864 2026-02-21T12:15:02.608 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: CEPH_ARGS= 2026-02-21T12:15:02.608 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: ceph-conf --show-config-value osd_bench_duration 2026-02-21T12:15:02.616 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: local osd_bench_duration=30 2026-02-21T12:15:02.616 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:58: TEST_bench: expect_failure td/osd-bench osd_bench_max_block_size ceph tell osd.0 bench 1024 67108865 2026-02-21T12:15:02.616 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2045: expect_failure: local dir=td/osd-bench 2026-02-21T12:15:02.616 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2046: expect_failure: shift 2026-02-21T12:15:02.616 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2047: expect_failure: local expected=osd_bench_max_block_size 2026-02-21T12:15:02.616 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2048: expect_failure: shift 2026-02-21T12:15:02.616 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2049: expect_failure: local success 2026-02-21T12:15:02.616 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2051: expect_failure: ceph tell osd.0 bench 1024 67108865 2026-02-21T12:15:02.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2054: expect_failure: success=false 2026-02-21T12:15:02.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2057: expect_failure: false 2026-02-21T12:15:02.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2057: expect_failure: grep --quiet osd_bench_max_block_size td/osd-bench/out 2026-02-21T12:15:02.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2061: expect_failure: return 0 2026-02-21T12:15:02.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:64: TEST_bench: local bsize=1024 2026-02-21T12:15:02.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:65: TEST_bench: local max_count=3072000 2026-02-21T12:15:02.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:66: TEST_bench: expect_failure td/osd-bench bench_small_size_max_iops ceph tell osd.0 bench 3072001 1024 2026-02-21T12:15:02.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2045: expect_failure: local dir=td/osd-bench 2026-02-21T12:15:02.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2046: expect_failure: shift 2026-02-21T12:15:02.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2047: expect_failure: local expected=bench_small_size_max_iops 2026-02-21T12:15:02.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2048: expect_failure: shift 2026-02-21T12:15:02.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2049: expect_failure: local success 2026-02-21T12:15:02.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2051: expect_failure: ceph tell osd.0 bench 3072001 1024 2026-02-21T12:15:02.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2054: expect_failure: success=false 2026-02-21T12:15:02.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2057: expect_failure: false 2026-02-21T12:15:02.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2057: expect_failure: grep --quiet bench_small_size_max_iops td/osd-bench/out 2026-02-21T12:15:02.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2061: expect_failure: return 0 2026-02-21T12:15:02.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:72: TEST_bench: local bsize=1048577 2026-02-21T12:15:02.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:73: TEST_bench: local max_count=3145728000 2026-02-21T12:15:02.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:74: TEST_bench: expect_failure td/osd-bench osd_bench_large_size_max_throughput ceph tell osd.0 bench 3145728001 1048577 2026-02-21T12:15:02.719 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2045: expect_failure: local dir=td/osd-bench 2026-02-21T12:15:02.719 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2046: expect_failure: shift 2026-02-21T12:15:02.719 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2047: expect_failure: local expected=osd_bench_large_size_max_throughput 2026-02-21T12:15:02.719 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2048: expect_failure: shift 2026-02-21T12:15:02.719 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2049: expect_failure: local success 2026-02-21T12:15:02.719 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2051: expect_failure: ceph tell osd.0 bench 3145728001 1048577 2026-02-21T12:15:02.771 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2054: expect_failure: success=false 2026-02-21T12:15:02.771 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2057: expect_failure: false 2026-02-21T12:15:02.771 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2057: expect_failure: grep --quiet osd_bench_large_size_max_throughput td/osd-bench/out 2026-02-21T12:15:02.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2061: expect_failure: return 0 2026-02-21T12:15:02.772 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:80: TEST_bench: ceph tell osd.0 bench 2026-02-21T12:15:04.380 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:15:04.380 INFO:tasks.workunit.client.0.trial058.stdout: "bytes_written": 1073741824, 2026-02-21T12:15:04.380 INFO:tasks.workunit.client.0.trial058.stdout: "blocksize": 4194304, 2026-02-21T12:15:04.380 INFO:tasks.workunit.client.0.trial058.stdout: "elapsed_sec": 0.74017123799999995, 2026-02-21T12:15:04.380 INFO:tasks.workunit.client.0.trial058.stdout: "bytes_per_sec": 1450666776.6520267, 2026-02-21T12:15:04.380 INFO:tasks.workunit.client.0.trial058.stdout: "iops": 345.86591163921992 2026-02-21T12:15:04.380 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:15:04.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:84: TEST_bench: ceph tell osd.0 bench 10 14456 4444 3 2026-02-21T12:15:04.442 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:15:04.442 INFO:tasks.workunit.client.0.trial058.stdout: "bytes_written": 10, 2026-02-21T12:15:04.442 INFO:tasks.workunit.client.0.trial058.stdout: "blocksize": 14456, 2026-02-21T12:15:04.442 INFO:tasks.workunit.client.0.trial058.stdout: "elapsed_sec": 0.00028576600000000001, 2026-02-21T12:15:04.442 INFO:tasks.workunit.client.0.trial058.stdout: "bytes_per_sec": 34993.666146427495, 2026-02-21T12:15:04.442 INFO:tasks.workunit.client.0.trial058.stdout: "iops": 2.4207018640306788 2026-02-21T12:15:04.442 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:15:04.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:90: TEST_bench: ceph tell osd.0 bench 1 14456 2026-02-21T12:15:04.503 INFO:tasks.workunit.client.0.trial058.stdout:{ 2026-02-21T12:15:04.503 INFO:tasks.workunit.client.0.trial058.stdout: "bytes_written": 1, 2026-02-21T12:15:04.503 INFO:tasks.workunit.client.0.trial058.stdout: "blocksize": 14456, 2026-02-21T12:15:04.503 INFO:tasks.workunit.client.0.trial058.stdout: "elapsed_sec": 0.00016998800000000001, 2026-02-21T12:15:04.504 INFO:tasks.workunit.client.0.trial058.stdout: "bytes_per_sec": 5882.7681954020281, 2026-02-21T12:15:04.504 INFO:tasks.workunit.client.0.trial058.stdout: "iops": 0.40694301296361568 2026-02-21T12:15:04.504 INFO:tasks.workunit.client.0.trial058.stdout:} 2026-02-21T12:15:04.508 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:35: run: teardown td/osd-bench 2026-02-21T12:15:04.508 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-21T12:15:04.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:15:04.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-21T12:15:04.509 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:15:04.509 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:15:04.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:15:04.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:15:04.509 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:15:04.615 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:15:04.616 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:15:04.616 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:15:04.617 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:15:04.618 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:15:04.618 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:15:04.619 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:15:04.619 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:15:04.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:15:04.620 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:15:04.620 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:15:04.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:15:04.622 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:15:04.622 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-21T12:15:04.647 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:15:04.647 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:04.647 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.106920 2026-02-21T12:15:04.647 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.106920 2026-02-21T12:15:04.648 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:15:04.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:15:04.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2429: main: code=0 2026-02-21T12:15:04.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2433: main: teardown td/osd-bench 0 2026-02-21T12:15:04.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-21T12:15:04.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-21T12:15:04.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-21T12:15:04.649 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:15:04.649 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:15:04.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:15:04.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:15:04.649 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:15:04.650 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:15:04.650 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:15:04.651 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:15:04.651 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:15:04.652 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:15:04.652 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:15:04.652 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:15:04.653 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:15:04.653 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:15:04.653 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:15:04.653 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:15:04.654 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:15:04.655 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-21T12:15:04.655 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-21T12:15:04.656 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:15:04.656 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:04.656 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.106920 2026-02-21T12:15:04.656 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.106920 2026-02-21T12:15:04.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:15:04.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:15:04.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2434: main: return 0 2026-02-21T12:15:04.658 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-21T12:15:04.658 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-21T12:15:04.722 INFO:tasks.workunit:Running workunit osd/osd-bluefs-volume-ops.sh... 2026-02-21T12:15:04.722 DEBUG:teuthology.orchestra.run.trial058:workunit test osd/osd-bluefs-volume-ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f7273f3049146bdd7fa7b4a400114872a50228e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2026-02-21T12:15:04.783 INFO:tasks.workunit.client.0.trial058.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-21T12:15:04.788 INFO:tasks.workunit.client.0.trial058.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-21T12:15:04.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2422: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-21T12:15:04.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2422: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-21T12:15:04.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: main: export PYTHONWARNINGS=ignore 2026-02-21T12:15:04.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: main: PYTHONWARNINGS=ignore 2026-02-21T12:15:04.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2424: main: export CEPH_CONF=/dev/null 2026-02-21T12:15:04.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2424: main: CEPH_CONF=/dev/null 2026-02-21T12:15:04.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2425: main: unset CEPH_ARGS 2026-02-21T12:15:04.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: main: local code 2026-02-21T12:15:04.789 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2428: main: run td/osd-bluefs-volume-ops 2026-02-21T12:15:04.790 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:8: run: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:15:04.790 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:9: run: shift 2026-02-21T12:15:04.790 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: set 2026-02-21T12:15:04.790 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-21T12:15:04.791 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: local 'funcs=TEST_bluestore 2026-02-21T12:15:04.791 INFO:tasks.workunit.client.0.trial058.stderr:TEST_bluestore2 2026-02-21T12:15:04.791 INFO:tasks.workunit.client.0.trial058.stderr:TEST_bluestore_expand' 2026-02-21T12:15:04.791 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-21T12:15:04.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-21T12:15:04.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:15:04.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-21T12:15:04.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:15:04.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:15:04.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-21T12:15:04.792 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:15:04.792 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:15:04.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:15:04.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:15:04.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:15:04.793 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:15:04.793 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:15:04.793 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:15:04.794 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:15:04.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:15:04.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:15:04.794 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:15:04.795 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:15:04.795 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:15:04.795 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:15:04.796 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:15:04.796 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:15:04.797 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:15:04.797 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-21T12:15:04.798 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:15:04.798 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:04.798 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:15:04.798 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108826 2026-02-21T12:15:04.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:15:04.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:15:04.799 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-21T12:15:04.800 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-21T12:15:04.800 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:04.800 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:15:04.800 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.108826 2026-02-21T12:15:04.801 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-21T12:15:04.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-21T12:15:04.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-21T12:15:04.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-21T12:15:04.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-21T12:15:04.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore td/osd-bluefs-volume-ops 2026-02-21T12:15:04.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:20: TEST_bluestore: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:15:04.803 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: ulimit -n 2026-02-21T12:15:04.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: local flimit=4096 2026-02-21T12:15:04.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:23: TEST_bluestore: '[' 4096 -lt 1536 ']' 2026-02-21T12:15:04.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: export CEPH_MON=127.0.0.1:7146 2026-02-21T12:15:04.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: CEPH_MON=127.0.0.1:7146 2026-02-21T12:15:04.804 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:27: TEST_bluestore: export CEPH_ARGS 2026-02-21T12:15:04.804 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: uuidgen 2026-02-21T12:15:04.805 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: CEPH_ARGS+='--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none ' 2026-02-21T12:15:04.805 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:29: TEST_bluestore: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-21T12:15:04.805 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:30: TEST_bluestore: CEPH_ARGS+='--bluestore_block_size=2147483648 ' 2026-02-21T12:15:04.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:31: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-21T12:15:04.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-21T12:15:04.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:33: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_size=536870912 ' 2026-02-21T12:15:04.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:34: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_create=true ' 2026-02-21T12:15:04.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:35: TEST_bluestore: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-21T12:15:04.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:37: TEST_bluestore: CEPH_ARGS+='--bluestore_allocation_from_file=1 ' 2026-02-21T12:15:04.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:39: TEST_bluestore: run_mon td/osd-bluefs-volume-ops a 2026-02-21T12:15:04.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:15:04.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-21T12:15:04.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-21T12:15:04.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-21T12:15:04.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-21T12:15:04.807 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-21T12:15:04.821 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-21T12:15:04.821 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:15:04.821 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:15:04.821 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:15:04.821 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:04.821 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:15:04.821 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:15:04.821 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-21T12:15:04.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-21T12:15:04.843 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-21T12:15:04.843 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:15:04.844 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:15:04.844 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-21T12:15:04.844 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-21T12:15:04.844 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:15:04.844 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:15:04.844 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:15:04.845 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:15:04.845 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:04.845 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:15:04.845 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108826/ceph-mon.a.asok 2026-02-21T12:15:04.845 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:15:04.845 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108826/ceph-mon.a.asok config get fsid 2026-02-21T12:15:04.889 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-21T12:15:04.889 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:15:04.889 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:15:04.890 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-21T12:15:04.890 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-21T12:15:04.890 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:15:04.890 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:15:04.890 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:15:04.890 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:15:04.890 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:04.890 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:15:04.890 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108826/ceph-mon.a.asok 2026-02-21T12:15:04.891 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:15:04.891 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108826/ceph-mon.a.asok config get mon_host 2026-02-21T12:15:04.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: run_mgr td/osd-bluefs-volume-ops x 2026-02-21T12:15:04.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:15:04.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-21T12:15:04.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-21T12:15:04.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-21T12:15:04.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-21T12:15:04.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-21T12:15:05.028 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-21T12:15:05.028 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:15:05.028 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:15:05.028 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:15:05.028 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:05.028 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:15:05.028 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:15:05.028 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:15:05.029 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:41: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 0 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:15:05.044 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:15:05.045 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:15:05.045 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:05.045 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:15:05.045 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:15:05.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:15:05.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:15:05.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:15:05.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:15:05.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:15:05.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:15:05.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:15:05.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:15:05.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:15:05.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:15:05.046 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:15:05.047 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:15:05.047 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-21T12:15:05.047 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:15:05.047 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=950bc319-8879-4c2d-b18b-2509ee8724fa 2026-02-21T12:15:05.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 950bc319-8879-4c2d-b18b-2509ee8724fa' 2026-02-21T12:15:05.048 INFO:tasks.workunit.client.0.trial058.stdout:add osd0 950bc319-8879-4c2d-b18b-2509ee8724fa 2026-02-21T12:15:05.048 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:15:05.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDJoZlp+FcaBBAA0E1nakBw91uHWk+4nBTA7w== 2026-02-21T12:15:05.058 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDJoZlp+FcaBBAA0E1nakBw91uHWk+4nBTA7w=="}' 2026-02-21T12:15:05.058 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 950bc319-8879-4c2d-b18b-2509ee8724fa -i td/osd-bluefs-volume-ops/0/new.json 2026-02-21T12:15:05.158 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:15:05.164 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-21T12:15:05.164 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDJoZlp+FcaBBAA0E1nakBw91uHWk+4nBTA7w== --osd-uuid 950bc319-8879-4c2d-b18b-2509ee8724fa 2026-02-21T12:15:05.180 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:05.192+0000 7fbd5a841780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:05.182 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:05.193+0000 7fbd5a841780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:05.183 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:05.194+0000 7fbd5a841780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:05.183 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:05.195+0000 7fbd5a841780 -1 bdev(0x3446c00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-21T12:15:05.183 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:05.195+0000 7fbd5a841780 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-21T12:15:06.076 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-21T12:15:06.077 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:15:06.077 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-21T12:15:06.078 INFO:tasks.workunit.client.0.trial058.stdout:adding osd0 key to auth repository 2026-02-21T12:15:06.078 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:15:06.178 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-21T12:15:06.179 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:15:06.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:15:06.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:15:06.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:15:06.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:15:06.192 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:06.204+0000 7f1acc046780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:06.194 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:06.205+0000 7f1acc046780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:06.194 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:06.206+0000 7f1acc046780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:06.273 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-21T12:15:06.273 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:15:06.273 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:15:06.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:15:06.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:15:06.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:15:06.274 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:15:06.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:15:06.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:15:06.274 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:15:06.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:15:06.417 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:06.428+0000 7f1acc046780 -1 Falling back to public interface 2026-02-21T12:15:07.140 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:07.152+0000 7f1acc046780 -1 osd.0 0 log_to_monitors true 2026-02-21T12:15:07.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:15:07.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:15:07.370 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:15:07.370 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:15:07.371 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:15:07.371 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:15:07.598 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:15:08.598 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:15:08.598 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:15:08.599 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:15:08.599 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:15:08.599 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:15:08.599 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:15:08.822 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/929571216,v1:127.0.0.1:6801/929571216] [v2:127.0.0.1:6802/929571216,v1:127.0.0.1:6803/929571216] exists,up 950bc319-8879-4c2d-b18b-2509ee8724fa 2026-02-21T12:15:08.828 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:15:08.828 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:15:08.828 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:15:08.828 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-21T12:15:08.829 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: osd_pid0=110200 2026-02-21T12:15:08.829 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:43: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 1 2026-02-21T12:15:08.829 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:15:08.829 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:15:08.829 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-21T12:15:08.829 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:15:08.829 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-21T12:15:08.830 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:15:08.830 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:15:08.830 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:15:08.830 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:15:08.830 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-21T12:15:08.830 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-21T12:15:08.831 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:15:08.831 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:15:08.831 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:15:08.831 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:15:08.831 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:15:08.831 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:15:08.832 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:15:08.832 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:08.832 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:15:08.832 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:15:08.832 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:15:08.832 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:15:08.833 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:15:08.833 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:15:08.833 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:15:08.833 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:15:08.833 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:15:08.833 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:15:08.834 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:15:08.834 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:15:08.834 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:15:08.834 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:15:08.834 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-21T12:15:08.834 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:15:08.835 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2fe7c6b6-11f6-40d3-b860-a039bbd5c5e5 2026-02-21T12:15:08.835 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 2fe7c6b6-11f6-40d3-b860-a039bbd5c5e5' 2026-02-21T12:15:08.835 INFO:tasks.workunit.client.0.trial058.stdout:add osd1 2fe7c6b6-11f6-40d3-b860-a039bbd5c5e5 2026-02-21T12:15:08.837 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:15:08.837 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDMoZlpe7l+MhAAWKTSFZd073Ti56GDRlSMOg== 2026-02-21T12:15:08.837 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDMoZlpe7l+MhAAWKTSFZd073Ti56GDRlSMOg=="}' 2026-02-21T12:15:08.837 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2fe7c6b6-11f6-40d3-b860-a039bbd5c5e5 -i td/osd-bluefs-volume-ops/1/new.json 2026-02-21T12:15:09.062 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:15:09.070 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/1/new.json 2026-02-21T12:15:09.071 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDMoZlpe7l+MhAAWKTSFZd073Ti56GDRlSMOg== --osd-uuid 2fe7c6b6-11f6-40d3-b860-a039bbd5c5e5 2026-02-21T12:15:09.086 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:09.097+0000 7f717623b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:09.088 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:09.099+0000 7f717623b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:09.089 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:09.100+0000 7f717623b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:09.089 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:09.100+0000 7f717623b780 -1 bdev(0x24e4c00 td/osd-bluefs-volume-ops/1/block) open stat got: (1) Operation not permitted 2026-02-21T12:15:09.089 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:09.100+0000 7f717623b780 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_fsid unparsable uuid 2026-02-21T12:15:09.782 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/1/keyring 2026-02-21T12:15:09.782 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:15:09.783 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-21T12:15:09.783 INFO:tasks.workunit.client.0.trial058.stdout:adding osd1 key to auth repository 2026-02-21T12:15:09.783 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:15:10.097 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:15:10.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-21T12:15:10.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:15:10.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:15:10.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:15:10.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:15:10.111 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:10.123+0000 7f28c5858780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:10.113 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:10.124+0000 7f28c5858780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:10.114 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:10.125+0000 7f28c5858780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:10.309 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:10.321+0000 7f28c5858780 -1 Falling back to public interface 2026-02-21T12:15:10.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-21T12:15:10.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:15:10.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:15:10.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:15:10.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:15:10.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:15:10.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:15:10.323 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:15:10.323 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:15:10.323 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:15:10.548 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:15:10.901 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:10.912+0000 7f28c5858780 -1 osd.1 0 log_to_monitors true 2026-02-21T12:15:11.550 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:15:11.550 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:15:11.550 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:15:11.551 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:15:11.551 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:15:11.551 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:15:11.774 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2108162720,v1:127.0.0.1:6811/2108162720] [v2:127.0.0.1:6812/2108162720,v1:127.0.0.1:6813/2108162720] exists,up 2fe7c6b6-11f6-40d3-b860-a039bbd5c5e5 2026-02-21T12:15:11.775 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:15:11.775 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:15:11.775 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:15:11.775 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-21T12:15:11.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: osd_pid1=112630 2026-02-21T12:15:11.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:45: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 2 2026-02-21T12:15:11.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:15:11.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:15:11.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:15:11.778 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:15:11.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:15:11.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:15:11.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:15:11.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:15:11.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:15:11.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:15:11.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:15:11.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:15:11.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:15:11.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:15:11.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:15:11.780 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:15:11.781 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-21T12:15:11.781 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:15:11.781 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0dd91019-62fc-41dd-93d2-b1eee4107630 2026-02-21T12:15:11.781 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 0dd91019-62fc-41dd-93d2-b1eee4107630' 2026-02-21T12:15:11.781 INFO:tasks.workunit.client.0.trial058.stdout:add osd2 0dd91019-62fc-41dd-93d2-b1eee4107630 2026-02-21T12:15:11.781 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:15:11.790 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDPoZlpJnXOLxAAZrbunTDv4mmt09rIiYoHgA== 2026-02-21T12:15:11.791 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDPoZlpJnXOLxAAZrbunTDv4mmt09rIiYoHgA=="}' 2026-02-21T12:15:11.791 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0dd91019-62fc-41dd-93d2-b1eee4107630 -i td/osd-bluefs-volume-ops/2/new.json 2026-02-21T12:15:12.015 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:15:12.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/2/new.json 2026-02-21T12:15:12.023 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDPoZlpJnXOLxAAZrbunTDv4mmt09rIiYoHgA== --osd-uuid 0dd91019-62fc-41dd-93d2-b1eee4107630 2026-02-21T12:15:12.038 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:12.049+0000 7fd9b1439780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:12.039 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:12.050+0000 7fd9b1439780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:12.040 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:12.051+0000 7fd9b1439780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:12.040 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:12.052+0000 7fd9b1439780 -1 bdev(0x36a4c00 td/osd-bluefs-volume-ops/2/block) open stat got: (1) Operation not permitted 2026-02-21T12:15:12.040 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:12.052+0000 7fd9b1439780 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_fsid unparsable uuid 2026-02-21T12:15:12.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/2/keyring 2026-02-21T12:15:12.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:15:12.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-21T12:15:12.719 INFO:tasks.workunit.client.0.trial058.stdout:adding osd2 key to auth repository 2026-02-21T12:15:12.719 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:15:13.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-21T12:15:13.033 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:15:13.034 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:15:13.034 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:15:13.034 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:15:13.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:15:13.050 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:13.061+0000 7fd4fe83b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:13.051 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:13.062+0000 7fd4fe83b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:13.051 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:13.063+0000 7fd4fe83b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:13.247 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:13.258+0000 7fd4fe83b780 -1 Falling back to public interface 2026-02-21T12:15:13.259 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-21T12:15:13.259 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:15:13.259 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:15:13.259 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:15:13.259 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:15:13.259 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:15:13.259 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:15:13.259 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:15:13.259 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:15:13.259 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:15:13.484 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:15:13.808 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:13.819+0000 7fd4fe83b780 -1 osd.2 0 log_to_monitors true 2026-02-21T12:15:14.485 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:15:14.485 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:15:14.486 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:15:14.486 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:15:14.486 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:15:14.486 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:15:14.710 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1923587304,v1:127.0.0.1:6819/1923587304] [v2:127.0.0.1:6820/1923587304,v1:127.0.0.1:6821/1923587304] exists,up 0dd91019-62fc-41dd-93d2-b1eee4107630 2026-02-21T12:15:14.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:15:14.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:15:14.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:15:14.711 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-21T12:15:14.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: osd_pid2=114751 2026-02-21T12:15:14.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:47: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 3 2026-02-21T12:15:14.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:15:14.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:15:14.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-21T12:15:14.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:15:14.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-21T12:15:14.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:15:14.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:15:14.715 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:15:14.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:15:14.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-21T12:15:14.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-21T12:15:14.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:15:14.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:15:14.716 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:15:14.716 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:15:14.716 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:15:14.716 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:15:14.716 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:15:14.716 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:15:14.716 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:15:14.717 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:15:14.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-21T12:15:14.718 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:15:14.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=662140bc-0fd0-471c-b964-5adc0bb2aa18 2026-02-21T12:15:14.718 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 662140bc-0fd0-471c-b964-5adc0bb2aa18' 2026-02-21T12:15:14.719 INFO:tasks.workunit.client.0.trial058.stdout:add osd3 662140bc-0fd0-471c-b964-5adc0bb2aa18 2026-02-21T12:15:14.719 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:15:14.725 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDSoZlplBPqKxAAHoAyTioORACLYla0d4PWjQ== 2026-02-21T12:15:14.726 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDSoZlplBPqKxAAHoAyTioORACLYla0d4PWjQ=="}' 2026-02-21T12:15:14.726 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 662140bc-0fd0-471c-b964-5adc0bb2aa18 -i td/osd-bluefs-volume-ops/3/new.json 2026-02-21T12:15:14.953 INFO:tasks.workunit.client.0.trial058.stdout:3 2026-02-21T12:15:14.960 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/3/new.json 2026-02-21T12:15:14.961 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDSoZlplBPqKxAAHoAyTioORACLYla0d4PWjQ== --osd-uuid 662140bc-0fd0-471c-b964-5adc0bb2aa18 2026-02-21T12:15:14.976 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:14.988+0000 7f9e0b66c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:14.977 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:14.989+0000 7f9e0b66c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:14.978 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:14.990+0000 7f9e0b66c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:14.978 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:14.990+0000 7f9e0b66c780 -1 bdev(0x28a2c00 td/osd-bluefs-volume-ops/3/block) open stat got: (1) Operation not permitted 2026-02-21T12:15:14.979 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:14.990+0000 7f9e0b66c780 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_fsid unparsable uuid 2026-02-21T12:15:15.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/3/keyring 2026-02-21T12:15:15.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:15:15.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-21T12:15:15.641 INFO:tasks.workunit.client.0.trial058.stdout:adding osd3 key to auth repository 2026-02-21T12:15:15.641 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:15:15.951 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-21T12:15:15.951 INFO:tasks.workunit.client.0.trial058.stdout:start osd.3 2026-02-21T12:15:15.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:15:15.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:15:15.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:15:15.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:15:15.965 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:15.977+0000 7f3169472780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:15.967 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:15.978+0000 7f3169472780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:15.967 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:15.979+0000 7f3169472780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:15:16.124 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:16.136+0000 7f3169472780 -1 Falling back to public interface 2026-02-21T12:15:16.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-21T12:15:16.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:15:16.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-21T12:15:16.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:15:16.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:15:16.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:15:16.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:15:16.175 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:15:16.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:15:16.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:15:16.403 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:15:16.713 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:15:16.725+0000 7f3169472780 -1 osd.3 0 log_to_monitors true 2026-02-21T12:15:17.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:15:17.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:15:17.404 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:15:17.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:15:17.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:15:17.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:15:17.626 INFO:tasks.workunit.client.0.trial058.stdout:osd.3 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2388979758,v1:127.0.0.1:6827/2388979758] [v2:127.0.0.1:6828/2388979758,v1:127.0.0.1:6829/2388979758] exists,up 662140bc-0fd0-471c-b964-5adc0bb2aa18 2026-02-21T12:15:17.627 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:15:17.627 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:15:17.627 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:15:17.627 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-21T12:15:17.628 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: osd_pid3=116872 2026-02-21T12:15:17.628 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:50: TEST_bluestore: sleep 5 2026-02-21T12:15:22.629 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:52: TEST_bluestore: create_pool foo 16 2026-02-21T12:15:22.629 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-21T12:15:22.902 INFO:tasks.workunit.client.0.trial058.stderr:pool 'foo' already exists 2026-02-21T12:15:22.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-21T12:15:23.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:55: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-21T12:15:23.930 INFO:tasks.workunit.client.0.trial058.stdout:hints = 1 2026-02-21T12:15:23.930 INFO:tasks.workunit.client.0.trial058.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-21T12:15:23.930 INFO:tasks.workunit.client.0.trial058.stdout:Object prefix: benchmark_data_trial058_117865 2026-02-21T12:15:23.930 INFO:tasks.workunit.client.0.trial058.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-21T12:15:23.930 INFO:tasks.workunit.client.0.trial058.stdout: 0 0 0 0 0 0 - 0 2026-02-21T12:15:24.930 INFO:tasks.workunit.client.0.trial058.stdout: 1 16 11911 11895 46.4613 46.4648 0.00162906 0.0013429 2026-02-21T12:15:25.931 INFO:tasks.workunit.client.0.trial058.stdout: 2 16 23744 23728 46.3402 46.2227 0.00100565 0.00134704 2026-02-21T12:15:26.931 INFO:tasks.workunit.client.0.trial058.stdout: 3 16 35739 35723 46.5107 46.8555 0.00170796 0.00134225 2026-02-21T12:15:27.931 INFO:tasks.workunit.client.0.trial058.stdout: 4 16 47441 47425 46.3099 45.7109 0.00102424 0.00134815 2026-02-21T12:15:28.931 INFO:tasks.workunit.client.0.trial058.stdout: 5 16 59118 59102 46.1699 45.6133 0.00124881 0.00135232 2026-02-21T12:15:29.931 INFO:tasks.workunit.client.0.trial058.stdout: 6 16 70799 70783 46.0791 45.6289 0.00123223 0.001355 2026-02-21T12:15:30.931 INFO:tasks.workunit.client.0.trial058.stdout: 7 16 82625 82609 46.0952 46.1953 0.00104426 0.00135462 2026-02-21T12:15:31.931 INFO:tasks.workunit.client.0.trial058.stdout: 8 16 94426 94410 46.0951 46.0977 0.000948959 0.00135458 2026-02-21T12:15:32.931 INFO:tasks.workunit.client.0.trial058.stdout: 9 16 106164 106148 46.0676 45.8516 0.000684814 0.0013554 2026-02-21T12:15:33.931 INFO:tasks.workunit.client.0.trial058.stdout: 10 16 117958 117942 46.0675 46.0703 0.00142183 0.00135545 2026-02-21T12:15:34.931 INFO:tasks.workunit.client.0.trial058.stdout: 11 16 129896 129880 46.1186 46.6328 0.00131678 0.00135393 2026-02-21T12:15:35.932 INFO:tasks.workunit.client.0.trial058.stdout: 12 16 141271 141255 45.9772 44.4336 0.00144642 0.00135812 2026-02-21T12:15:36.932 INFO:tasks.workunit.client.0.trial058.stdout: 13 16 145805 145789 43.8028 17.7109 0.131836 0.00141329 2026-02-21T12:15:37.932 INFO:tasks.workunit.client.0.trial058.stdout: 14 16 154717 154701 43.1604 34.8125 0.00113308 0.00144683 2026-02-21T12:15:38.932 INFO:tasks.workunit.client.0.trial058.stdout: 15 15 164986 164971 42.9573 40.1172 0.00140307 0.00145364 2026-02-21T12:15:39.932 INFO:tasks.workunit.client.0.trial058.stdout: 16 16 175130 175114 42.7486 39.6211 0.00145573 0.00146077 2026-02-21T12:15:40.932 INFO:tasks.workunit.client.0.trial058.stdout: 17 16 185214 185198 42.5509 39.3906 0.00200699 0.00146757 2026-02-21T12:15:41.932 INFO:tasks.workunit.client.0.trial058.stdout: 18 16 195340 195324 42.3843 39.5547 0.00167542 0.00147334 2026-02-21T12:15:42.932 INFO:tasks.workunit.client.0.trial058.stdout: 19 16 201209 201193 41.3601 22.9258 0.116865 0.00150236 2026-02-21T12:15:43.932 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:15:43.944777+0000 min lat: 0.00041055 max lat: 0.24734 avg lat: 0.00158558 2026-02-21T12:15:43.932 INFO:tasks.workunit.client.0.trial058.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-21T12:15:43.932 INFO:tasks.workunit.client.0.trial058.stdout: 20 16 201317 201301 39.3132 0.421875 0.068756 0.00158558 2026-02-21T12:15:44.932 INFO:tasks.workunit.client.0.trial058.stdout: 21 16 201429 201413 37.462 0.4375 0.123237 0.00166421 2026-02-21T12:15:45.932 INFO:tasks.workunit.client.0.trial058.stdout: 22 16 201522 201506 35.7757 0.363281 0.192745 0.00173686 2026-02-21T12:15:46.933 INFO:tasks.workunit.client.0.trial058.stdout: 23 16 201610 201594 34.2352 0.34375 0.174851 0.00181427 2026-02-21T12:15:47.932 INFO:tasks.workunit.client.0.trial058.stdout: 24 16 201713 201697 32.8255 0.402344 0.192863 0.0018957 2026-02-21T12:15:48.933 INFO:tasks.workunit.client.0.trial058.stdout: 25 16 210030 210014 32.812 32.4883 0.00123875 0.00190344 2026-02-21T12:15:49.933 INFO:tasks.workunit.client.0.trial058.stdout: 26 16 220203 220187 33.0782 39.7383 0.00177214 0.0018882 2026-02-21T12:15:50.933 INFO:tasks.workunit.client.0.trial058.stdout: 27 16 230313 230297 33.3157 39.4922 0.00203159 0.00187475 2026-02-21T12:15:51.933 INFO:tasks.workunit.client.0.trial058.stdout: 28 16 240574 240558 33.5572 40.082 0.00152406 0.00186126 2026-02-21T12:15:52.933 INFO:tasks.workunit.client.0.trial058.stdout: 29 16 250796 250780 33.7769 39.9297 0.00219125 0.00184913 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Total time run: 30.0009 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Total writes made: 261040 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Write size: 4096 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Object size: 4096 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Bandwidth (MB/sec): 33.9885 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Stddev Bandwidth: 16.9322 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Max bandwidth (MB/sec): 46.8555 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Min bandwidth (MB/sec): 0.34375 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Average IOPS: 8701 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Stddev IOPS: 4334.63 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Max IOPS: 11995 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Min IOPS: 88 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Average Latency(s): 0.00183762 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Stddev Latency(s): 0.00787752 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Max latency(s): 0.261839 2026-02-21T12:15:53.933 INFO:tasks.workunit.client.0.trial058.stdout:Min latency(s): 0.00041055 2026-02-21T12:15:53.935 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:57: TEST_bluestore: echo 'after bench' 2026-02-21T12:15:53.935 INFO:tasks.workunit.client.0.trial058.stdout:after bench 2026-02-21T12:15:53.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 110200 2026-02-21T12:15:53.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2026-02-21T12:15:54.938 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 110200 2026-02-21T12:15:54.938 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 60: kill: (110200) - No such process 2026-02-21T12:15:54.938 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:61: TEST_bluestore: ceph osd down 0 2026-02-21T12:15:55.164 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already down. 2026-02-21T12:15:55.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 112630 2026-02-21T12:15:55.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2026-02-21T12:15:56.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 112630 2026-02-21T12:15:56.173 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 62: kill: (112630) - No such process 2026-02-21T12:15:56.173 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:63: TEST_bluestore: ceph osd down 1 2026-02-21T12:15:56.395 INFO:tasks.workunit.client.0.trial058.stderr:osd.1 is already down. 2026-02-21T12:15:56.403 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 114751 2026-02-21T12:15:56.403 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2026-02-21T12:15:57.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 114751 2026-02-21T12:15:57.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 64: kill: (114751) - No such process 2026-02-21T12:15:57.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:65: TEST_bluestore: ceph osd down 2 2026-02-21T12:15:57.630 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already down. 2026-02-21T12:15:57.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 116872 2026-02-21T12:15:57.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: sleep 1 2026-02-21T12:15:58.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 116872 2026-02-21T12:15:58.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 66: kill: (116872) - No such process 2026-02-21T12:15:58.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:67: TEST_bluestore: ceph osd down 3 2026-02-21T12:15:58.912 INFO:tasks.workunit.client.0.trial058.stderr:osd.3 is already down. 2026-02-21T12:15:58.919 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:70: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-21T12:16:01.552 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:01.574 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:71: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-21T12:16:04.205 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:04.226 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:72: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-21T12:16:06.855 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:06.874 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:73: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-21T12:16:09.520 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:09.540 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:75: TEST_bluestore: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-21T12:16:09.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-21T12:16:09.550 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:16:11.704 INFO:tasks.workunit.client.0.trial058.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-21T12:16:11.705 INFO:tasks.workunit.client.0.trial058.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-21T12:16:11.705 INFO:tasks.workunit.client.0.trial058.stdout:2 : device size 0x100000000(4 GiB) : using 0xafbf0000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xafbf0000(2.7 GiB) 2026-02-21T12:16:11.705 INFO:tasks.workunit.client.0.trial058.stdout:Expanding DB/WAL... 2026-02-21T12:16:11.705 INFO:tasks.workunit.client.0.trial058.stdout:0 : nothing to do, skipped 2026-02-21T12:16:11.705 INFO:tasks.workunit.client.0.trial058.stdout:1 : nothing to do, skipped 2026-02-21T12:16:11.705 INFO:tasks.workunit.client.0.trial058.stdout:2 : Expanding to 0x100000000(4 GiB) 2026-02-21T12:16:11.705 INFO:tasks.workunit.client.0.trial058.stdout:2 : size updated to 0x100000000(4 GiB) 2026-02-21T12:16:14.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:77: TEST_bluestore: truncate td/osd-bluefs-volume-ops/1/block -s 11811160064 2026-02-21T12:16:14.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:78: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 bluefs-bdev-expand 2026-02-21T12:16:14.084 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:16:16.225 INFO:tasks.workunit.client.0.trial058.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-21T12:16:16.225 INFO:tasks.workunit.client.0.trial058.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-21T12:16:16.225 INFO:tasks.workunit.client.0.trial058.stdout:2 : device size 0x2c0000000(11 GiB) : using 0x26fc56000(9.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0x26fc56000(9.7 GiB) 2026-02-21T12:16:16.225 INFO:tasks.workunit.client.0.trial058.stdout:Expanding DB/WAL... 2026-02-21T12:16:16.225 INFO:tasks.workunit.client.0.trial058.stdout:0 : nothing to do, skipped 2026-02-21T12:16:16.225 INFO:tasks.workunit.client.0.trial058.stdout:1 : nothing to do, skipped 2026-02-21T12:16:16.225 INFO:tasks.workunit.client.0.trial058.stdout:2 : Expanding to 0x2c0000000(11 GiB) 2026-02-21T12:16:16.226 INFO:tasks.workunit.client.0.trial058.stdout:2 : size updated to 0x2c0000000(11 GiB) 2026-02-21T12:16:18.574 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:79: TEST_bluestore: truncate td/osd-bluefs-volume-ops/2/block -s 4295099392 2026-02-21T12:16:18.575 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:80: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 bluefs-bdev-expand 2026-02-21T12:16:18.586 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:16:20.787 INFO:tasks.workunit.client.0.trial058.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-21T12:16:20.787 INFO:tasks.workunit.client.0.trial058.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-21T12:16:20.787 INFO:tasks.workunit.client.0.trial058.stdout:2 : device size 0x100020000(4.0 GiB) : using 0xafd1e000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xafd1e000(2.7 GiB) 2026-02-21T12:16:20.787 INFO:tasks.workunit.client.0.trial058.stdout:Expanding DB/WAL... 2026-02-21T12:16:20.788 INFO:tasks.workunit.client.0.trial058.stdout:0 : nothing to do, skipped 2026-02-21T12:16:20.790 INFO:tasks.workunit.client.0.trial058.stdout:1 : nothing to do, skipped 2026-02-21T12:16:20.790 INFO:tasks.workunit.client.0.trial058.stdout:2 : Expanding to 0x100020000(4.0 GiB) 2026-02-21T12:16:21.147 INFO:tasks.workunit.client.0.trial058.stdout:2 : size updated to 0x100020000(4.0 GiB) 2026-02-21T12:16:23.526 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:81: TEST_bluestore: truncate td/osd-bluefs-volume-ops/3/block -s 4293918720 2026-02-21T12:16:23.527 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:82: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 bluefs-bdev-expand 2026-02-21T12:16:23.537 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:16:25.725 INFO:tasks.workunit.client.0.trial058.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-21T12:16:25.725 INFO:tasks.workunit.client.0.trial058.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-21T12:16:25.725 INFO:tasks.workunit.client.0.trial058.stdout:2 : device size 0xfff00000(4.0 GiB) : using 0xafda5000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xafda5000(2.7 GiB) 2026-02-21T12:16:25.725 INFO:tasks.workunit.client.0.trial058.stdout:Expanding DB/WAL... 2026-02-21T12:16:25.725 INFO:tasks.workunit.client.0.trial058.stdout:0 : nothing to do, skipped 2026-02-21T12:16:25.725 INFO:tasks.workunit.client.0.trial058.stdout:1 : nothing to do, skipped 2026-02-21T12:16:25.726 INFO:tasks.workunit.client.0.trial058.stdout:2 : Expanding to 0xfff00000(4.0 GiB) 2026-02-21T12:16:25.726 INFO:tasks.workunit.client.0.trial058.stdout:2 : size updated to 0xfff00000(4.0 GiB) 2026-02-21T12:16:28.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:85: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-21T12:16:28.715 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:28.737 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:86: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-21T12:16:29.367 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:29.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:87: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-21T12:16:30.027 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:30.049 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:88: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-21T12:16:30.678 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:30.700 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:90: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-21T12:16:30.710 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:16:30.801 INFO:tasks.workunit.client.0.trial058.stdout:0 : device size 0x20000000(512 MiB) : using 0x1900000(25 MiB) 2026-02-21T12:16:30.802 INFO:tasks.workunit.client.0.trial058.stdout:1 : device size 0x40000000(1 GiB) : using 0x4100000(65 MiB) 2026-02-21T12:16:30.802 INFO:tasks.workunit.client.0.trial058.stdout:2 : device size 0x100000000(4 GiB) : using 0x2fbf0000(764 MiB) : bluefs used 0x0(0 B) : non-bluefs used 0x2fbf0000(764 MiB) 2026-02-21T12:16:30.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:92: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/block.db --command bluefs-bdev-migrate 2026-02-21T12:16:30.875 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:16:31.140 INFO:tasks.workunit.client.0.trial058.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-21T12:16:31.145 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:97: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-21T12:16:31.735 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:31.757 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:100: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-21T12:16:31.766 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:16:32.070 INFO:tasks.workunit.client.0.trial058.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-21T12:16:32.073 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:105: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-21T12:16:32.686 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:32.708 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:108: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block.wal --devs-source td/osd-bluefs-volume-ops/2/block.db --dev-target td/osd-bluefs-volume-ops/2/block --command bluefs-bdev-migrate 2026-02-21T12:16:32.717 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:16:33.065 INFO:tasks.workunit.client.0.trial058.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-21T12:16:33.065 INFO:tasks.workunit.client.0.trial058.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-21T12:16:33.071 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:114: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-21T12:16:33.639 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:33.661 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:117: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block.wal --command bluefs-bdev-migrate 2026-02-21T12:16:33.672 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:16:33.725 INFO:tasks.workunit.client.0.trial058.stderr:Migrate to WAL device isn't supported. 2026-02-21T12:16:33.727 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:123: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-21T12:16:33.727 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:126: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-21T12:16:34.354 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:34.377 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:129: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-21T12:16:34.386 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:16:34.662 INFO:tasks.workunit.client.0.trial058.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-21T12:16:34.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:134: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-21T12:16:35.269 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:35.292 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:136: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --dev-target td/osd-bluefs-volume-ops/3/block.db --command bluefs-bdev-migrate 2026-02-21T12:16:35.302 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:16:35.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:141: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-21T12:16:36.092 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:143: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:16:36.116 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:16:36.117 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-21T12:16:36.118 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-21T12:16:36.118 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:16:36.118 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:16:36.119 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-21T12:16:36.119 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-21T12:16:36.120 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:16:36.120 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:16:36.120 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:16:36.132 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:36.144+0000 7f26e983b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:16:36.134 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:36.145+0000 7f26e983b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:16:36.134 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:36.146+0000 7f26e983b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:16:36.276 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:36.287+0000 7f26e983b780 -1 Falling back to public interface 2026-02-21T12:16:36.346 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-21T12:16:36.346 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:16:36.346 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:16:36.346 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:16:36.346 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:16:36.346 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:16:36.346 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:16:36.347 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:16:36.347 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:16:36.347 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:16:36.574 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:16:37.456 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:37.467+0000 7f26e983b780 -1 osd.0 22 log_to_monitors true 2026-02-21T12:16:37.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:16:37.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:16:37.576 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:16:37.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:16:37.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:16:37.576 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:16:37.806 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:16:38.807 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:16:38.807 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:16:38.807 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:16:38.808 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:16:38.808 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:16:38.808 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:16:39.035 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 30 up_thru 30 down_at 22 last_clean_interval [5,22) [v2:127.0.0.1:6800/3811377800,v1:127.0.0.1:6801/3811377800] [v2:127.0.0.1:6802/3811377800,v1:127.0.0.1:6803/3811377800] exists,up 950bc319-8879-4c2d-b18b-2509ee8724fa 2026-02-21T12:16:39.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:16:39.036 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:16:39.036 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:16:39.036 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-21T12:16:39.039 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: osd_pid0=128520 2026-02-21T12:16:39.039 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:145: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-21T12:16:39.039 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:16:39.039 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:16:39.039 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-21T12:16:39.039 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:16:39.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-21T12:16:39.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:16:39.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:16:39.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:16:39.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:16:39.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-21T12:16:39.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-21T12:16:39.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:16:39.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:16:39.040 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:16:39.040 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:16:39.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:16:39.042 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:16:39.042 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:16:39.042 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:16:39.042 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-21T12:16:39.042 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-21T12:16:39.042 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:16:39.043 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:16:39.043 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-21T12:16:39.043 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-21T12:16:39.043 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:16:39.043 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:16:39.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:16:39.052 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:39.064+0000 7f96539d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:16:39.053 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:39.065+0000 7f96539d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:16:39.054 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:39.066+0000 7f96539d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:16:39.214 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:39.225+0000 7f96539d6780 -1 Falling back to public interface 2026-02-21T12:16:39.265 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-21T12:16:39.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:16:39.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:16:39.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:16:39.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:16:39.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:16:39.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:16:39.266 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:16:39.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:16:39.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:16:39.487 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:16:40.436 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:40.448+0000 7f96539d6780 -1 osd.1 23 log_to_monitors true 2026-02-21T12:16:40.489 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:16:40.489 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:16:40.489 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:16:40.490 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:16:40.490 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:16:40.490 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:16:40.721 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:16:41.722 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:16:41.722 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:16:41.723 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:16:41.723 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:16:41.723 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:16:41.723 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:16:41.947 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 34 up_thru 34 down_at 24 last_clean_interval [9,23) [v2:127.0.0.1:6810/751488058,v1:127.0.0.1:6811/751488058] [v2:127.0.0.1:6812/751488058,v1:127.0.0.1:6813/751488058] exists,up 2fe7c6b6-11f6-40d3-b860-a039bbd5c5e5 2026-02-21T12:16:41.948 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:16:41.948 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:16:41.948 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:16:41.948 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-21T12:16:41.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: osd_pid1=129463 2026-02-21T12:16:41.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:147: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-21T12:16:41.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:16:41.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:16:41.952 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-21T12:16:41.953 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:16:41.953 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-21T12:16:41.953 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:16:41.953 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:16:41.953 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:16:41.953 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:16:41.953 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-21T12:16:41.953 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-21T12:16:41.953 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:16:41.953 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:16:41.953 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:16:41.954 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:16:41.955 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:16:41.955 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:16:41.955 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:16:41.955 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:16:41.955 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-21T12:16:41.955 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-21T12:16:41.955 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:16:41.956 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:16:41.956 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-21T12:16:41.957 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-21T12:16:41.957 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:16:41.957 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:16:41.957 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:16:41.966 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:41.977+0000 7fcca160c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:16:41.967 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:41.978+0000 7fcca160c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:16:41.968 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:41.979+0000 7fcca160c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:16:42.144 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:42.156+0000 7fcca160c780 -1 Falling back to public interface 2026-02-21T12:16:42.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-21T12:16:42.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:16:42.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:16:42.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:16:42.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:16:42.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:16:42.182 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:16:42.183 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:16:42.183 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:16:42.183 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:16:42.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:16:43.332 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:43.342+0000 7fcca160c780 -1 osd.2 25 log_to_monitors true 2026-02-21T12:16:43.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:16:43.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:16:43.409 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:16:43.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:16:43.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:16:43.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:16:43.637 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:16:44.638 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:16:44.638 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:16:44.639 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:16:44.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:16:44.639 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:16:44.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:16:44.863 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 38 up_thru 38 down_at 26 last_clean_interval [13,25) [v2:127.0.0.1:6818/2439564248,v1:127.0.0.1:6819/2439564248] [v2:127.0.0.1:6820/2439564248,v1:127.0.0.1:6821/2439564248] exists,up 0dd91019-62fc-41dd-93d2-b1eee4107630 2026-02-21T12:16:44.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:16:44.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:16:44.864 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:16:44.864 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-21T12:16:44.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: osd_pid2=130403 2026-02-21T12:16:44.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:149: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-21T12:16:44.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:16:44.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:16:44.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-21T12:16:44.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:16:44.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-21T12:16:44.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:16:44.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:16:44.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:16:44.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:16:44.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-21T12:16:44.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-21T12:16:44.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:16:44.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:16:44.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:16:44.869 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:16:44.869 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:16:44.869 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:16:44.869 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:16:44.869 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:16:44.870 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:16:44.870 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:16:44.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:16:44.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:16:44.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:16:44.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:16:44.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:16:44.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:16:44.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:16:44.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:16:44.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:16:44.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:16:44.871 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-21T12:16:44.871 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-21T12:16:44.871 INFO:tasks.workunit.client.0.trial058.stdout:start osd.3 2026-02-21T12:16:44.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:16:44.872 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-21T12:16:44.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-21T12:16:44.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:16:44.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:16:44.872 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:16:44.881 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:44.891+0000 7fc90a644780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:16:44.882 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:44.892+0000 7fc90a644780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:16:44.883 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:44.893+0000 7fc90a644780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:16:45.075 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:45.085+0000 7fc90a644780 -1 Falling back to public interface 2026-02-21T12:16:45.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-21T12:16:45.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:16:45.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-21T12:16:45.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:16:45.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:16:45.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:16:45.098 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:16:45.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:16:45.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:16:45.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:16:45.322 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:16:46.322 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:16:46.333+0000 7fc90a644780 -1 osd.3 27 log_to_monitors true 2026-02-21T12:16:46.323 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:16:46.323 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:16:46.323 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:16:46.323 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:16:46.323 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:16:46.324 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:16:46.559 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:16:47.560 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:16:47.560 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:16:47.561 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:16:47.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:16:47.562 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:16:47.562 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:16:47.786 INFO:tasks.workunit.client.0.trial058.stdout:osd.3 up in weight 1 up_from 42 up_thru 42 down_at 28 last_clean_interval [17,27) [v2:127.0.0.1:6826/1731669450,v1:127.0.0.1:6827/1731669450] [v2:127.0.0.1:6828/1731669450,v1:127.0.0.1:6829/1731669450] exists,up 662140bc-0fd0-471c-b964-5adc0bb2aa18 2026-02-21T12:16:47.787 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:16:47.787 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:16:47.787 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:16:47.787 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-21T12:16:47.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: osd_pid3=131338 2026-02-21T12:16:47.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:152: TEST_bluestore: wait_for_clean 2026-02-21T12:16:47.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:16:47.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:16:47.788 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:16:47.788 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-21T12:16:47.789 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:16:47.789 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:16:47.789 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:16:47.789 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:16:47.789 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:16:47.871 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-21T12:16:47.871 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:16:47.871 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:16:47.871 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:16:47.871 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:16:47.871 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:16:48.097 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:16:48.097 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:16:48.098 INFO:tasks.workunit.client.0.trial058.stderr:2 2026-02-21T12:16:48.098 INFO:tasks.workunit.client.0.trial058.stderr:3' 2026-02-21T12:16:48.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:16:48.098 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:16:48.098 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:16:48.163 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=128849018885 2026-02-21T12:16:48.164 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 128849018885 2026-02-21T12:16:48.164 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-128849018885' 2026-02-21T12:16:48.164 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:16:48.164 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:16:48.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=146028888068 2026-02-21T12:16:48.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 146028888068 2026-02-21T12:16:48.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-128849018885 1-146028888068' 2026-02-21T12:16:48.229 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:16:48.229 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:16:48.291 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=163208757251 2026-02-21T12:16:48.292 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 163208757251 2026-02-21T12:16:48.292 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-128849018885 1-146028888068 2-163208757251' 2026-02-21T12:16:48.292 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:16:48.292 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-21T12:16:48.355 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=180388626435 2026-02-21T12:16:48.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 180388626435 2026-02-21T12:16:48.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-128849018885 1-146028888068 2-163208757251 3-180388626435' 2026-02-21T12:16:48.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:16:48.356 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-128849018885 2026-02-21T12:16:48.356 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:16:48.357 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:16:48.357 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-128849018885 2026-02-21T12:16:48.357 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:16:48.358 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=128849018885 2026-02-21T12:16:48.359 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 128849018885' 2026-02-21T12:16:48.359 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 128849018885 2026-02-21T12:16:48.359 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:16:48.586 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 128849018882 -lt 128849018885 2026-02-21T12:16:48.586 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:16:49.586 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:16:49.587 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:16:49.811 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 128849018885 -lt 128849018885 2026-02-21T12:16:49.811 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:16:49.812 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-146028888068 2026-02-21T12:16:49.812 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:16:49.813 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:16:49.814 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-146028888068 2026-02-21T12:16:49.814 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:16:49.815 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=146028888068 2026-02-21T12:16:49.815 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 146028888068' 2026-02-21T12:16:49.816 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 146028888068 2026-02-21T12:16:49.816 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:16:50.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 146028888068 -lt 146028888068 2026-02-21T12:16:50.041 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:16:50.041 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-163208757251 2026-02-21T12:16:50.042 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:16:50.042 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:16:50.043 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-163208757251 2026-02-21T12:16:50.043 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:16:50.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=163208757251 2026-02-21T12:16:50.044 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-21T12:16:50.044 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 163208757251 2026-02-21T12:16:50.045 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:16:50.268 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 163208757252 -lt 163208757251 2026-02-21T12:16:50.268 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:16:50.269 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 3-180388626435 2026-02-21T12:16:50.269 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:16:50.270 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=3 2026-02-21T12:16:50.270 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 3-180388626435 2026-02-21T12:16:50.271 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:16:50.272 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=180388626435 2026-02-21T12:16:50.272 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.3 seq 180388626435' 2026-02-21T12:16:50.272 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.3 seq 180388626435 2026-02-21T12:16:50.272 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-21T12:16:50.497 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 180388626435 -lt 180388626435 2026-02-21T12:16:50.497 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:16:50.498 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:16:50.498 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:16:50.815 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-21T12:16:50.815 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:16:50.815 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:16:50.815 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:16:50.815 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:16:50.815 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:16:50.816 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:16:50.816 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:16:51.034 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-21T12:16:51.035 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:16:51.035 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:16:51.036 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:16:51.354 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-21T12:16:51.355 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:16:51.355 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:16:51.355 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:155: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-21T12:16:51.371 INFO:tasks.workunit.client.0.trial058.stdout:hints = 1 2026-02-21T12:16:51.371 INFO:tasks.workunit.client.0.trial058.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-21T12:16:51.371 INFO:tasks.workunit.client.0.trial058.stdout:Object prefix: benchmark_data_trial058_132655 2026-02-21T12:16:51.371 INFO:tasks.workunit.client.0.trial058.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-21T12:16:51.371 INFO:tasks.workunit.client.0.trial058.stdout: 0 0 0 0 0 0 - 0 2026-02-21T12:16:52.371 INFO:tasks.workunit.client.0.trial058.stdout: 1 16 12696 12680 49.5274 49.5312 0.000451857 0.00125883 2026-02-21T12:16:53.371 INFO:tasks.workunit.client.0.trial058.stdout: 2 16 24886 24870 48.5706 47.6172 0.00114324 0.00128489 2026-02-21T12:16:54.371 INFO:tasks.workunit.client.0.trial058.stdout: 3 16 36955 36939 48.094 47.1445 0.00077342 0.00129681 2026-02-21T12:16:55.371 INFO:tasks.workunit.client.0.trial058.stdout: 4 16 49148 49132 47.9768 47.6289 0.00132085 0.00130127 2026-02-21T12:16:56.371 INFO:tasks.workunit.client.0.trial058.stdout: 5 16 61344 61328 47.9088 47.6406 0.000631965 0.00130234 2026-02-21T12:16:57.371 INFO:tasks.workunit.client.0.trial058.stdout: 6 16 72911 72895 47.4541 45.1836 0.000778229 0.00131555 2026-02-21T12:16:58.371 INFO:tasks.workunit.client.0.trial058.stdout: 7 15 84535 84520 47.1615 45.4102 0.00153849 0.00132385 2026-02-21T12:16:59.371 INFO:tasks.workunit.client.0.trial058.stdout: 8 16 96106 96090 46.9143 45.1953 0.00100534 0.0013309 2026-02-21T12:17:00.372 INFO:tasks.workunit.client.0.trial058.stdout: 9 16 107424 107408 46.6136 44.2109 0.00165812 0.00133948 2026-02-21T12:17:01.372 INFO:tasks.workunit.client.0.trial058.stdout: 10 16 118456 118440 46.2613 43.0938 0.00157297 0.00134963 2026-02-21T12:17:02.372 INFO:tasks.workunit.client.0.trial058.stdout: 11 16 129342 129326 45.9212 42.5234 0.00187669 0.00135963 2026-02-21T12:17:03.372 INFO:tasks.workunit.client.0.trial058.stdout: 12 16 140126 140110 45.6046 42.125 0.00207541 0.00136912 2026-02-21T12:17:04.372 INFO:tasks.workunit.client.0.trial058.stdout: 13 16 150610 150594 45.2465 40.9531 0.00111522 0.00138 2026-02-21T12:17:05.372 INFO:tasks.workunit.client.0.trial058.stdout: 14 16 161034 161018 44.9229 40.7188 0.00204406 0.00138995 2026-02-21T12:17:06.372 INFO:tasks.workunit.client.0.trial058.stdout: 15 16 171522 171506 44.6591 40.9688 0.00170888 0.00139818 2026-02-21T12:17:07.372 INFO:tasks.workunit.client.0.trial058.stdout: 16 16 182098 182082 44.4497 41.3125 0.00108005 0.00140475 2026-02-21T12:17:08.372 INFO:tasks.workunit.client.0.trial058.stdout: 17 16 183501 183485 42.1574 5.48047 0.107955 0.00147718 2026-02-21T12:17:09.373 INFO:tasks.workunit.client.0.trial058.stdout: 18 16 193352 193336 41.953 38.4805 0.00135931 0.00148844 2026-02-21T12:17:10.373 INFO:tasks.workunit.client.0.trial058.stdout: 19 16 203872 203856 41.9076 41.0938 0.00113904 0.00149006 2026-02-21T12:17:11.372 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:17:11.384949+0000 min lat: 0.000410199 max lat: 0.177163 avg lat: 0.00149316 2026-02-21T12:17:11.372 INFO:tasks.workunit.client.0.trial058.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-21T12:17:11.372 INFO:tasks.workunit.client.0.trial058.stdout: 20 16 214155 214139 41.8204 40.168 0.00195624 0.00149316 2026-02-21T12:17:12.373 INFO:tasks.workunit.client.0.trial058.stdout: 21 16 224500 224484 41.7531 40.4102 0.00185807 0.00149558 2026-02-21T12:17:13.373 INFO:tasks.workunit.client.0.trial058.stdout: 22 16 234912 234896 41.7038 40.6719 0.00270728 0.00149735 2026-02-21T12:17:14.373 INFO:tasks.workunit.client.0.trial058.stdout: 23 16 237870 237854 40.393 11.5547 0.0569799 0.00154107 2026-02-21T12:17:15.373 INFO:tasks.workunit.client.0.trial058.stdout: 24 16 237984 237968 38.7285 0.445312 0.0974551 0.00160711 2026-02-21T12:17:16.373 INFO:tasks.workunit.client.0.trial058.stdout: 25 16 238102 238086 37.1978 0.460938 0.117953 0.00167306 2026-02-21T12:17:17.373 INFO:tasks.workunit.client.0.trial058.stdout: 26 16 238224 238208 35.7855 0.476562 0.145617 0.0017415 2026-02-21T12:17:18.373 INFO:tasks.workunit.client.0.trial058.stdout: 27 16 238308 238292 34.4723 0.328125 0.167744 0.0018082 2026-02-21T12:17:19.373 INFO:tasks.workunit.client.0.trial058.stdout: 28 16 238403 238387 33.2544 0.371094 0.142596 0.00186958 2026-02-21T12:17:20.373 INFO:tasks.workunit.client.0.trial058.stdout: 29 16 239829 239813 32.2998 5.57031 0.00145665 0.00193368 2026-02-21T12:17:21.373 INFO:tasks.workunit.client.0.trial058.stdout:Total time run: 30.0016 2026-02-21T12:17:21.373 INFO:tasks.workunit.client.0.trial058.stdout:Total writes made: 250033 2026-02-21T12:17:21.373 INFO:tasks.workunit.client.0.trial058.stdout:Write size: 4096 2026-02-21T12:17:21.373 INFO:tasks.workunit.client.0.trial058.stdout:Object size: 4096 2026-02-21T12:17:21.373 INFO:tasks.workunit.client.0.trial058.stdout:Bandwidth (MB/sec): 32.5547 2026-02-21T12:17:21.373 INFO:tasks.workunit.client.0.trial058.stdout:Stddev Bandwidth: 18.6587 2026-02-21T12:17:21.374 INFO:tasks.workunit.client.0.trial058.stdout:Max bandwidth (MB/sec): 49.5312 2026-02-21T12:17:21.374 INFO:tasks.workunit.client.0.trial058.stdout:Min bandwidth (MB/sec): 0.328125 2026-02-21T12:17:21.374 INFO:tasks.workunit.client.0.trial058.stdout:Average IOPS: 8333 2026-02-21T12:17:21.374 INFO:tasks.workunit.client.0.trial058.stdout:Stddev IOPS: 4776.64 2026-02-21T12:17:21.374 INFO:tasks.workunit.client.0.trial058.stdout:Max IOPS: 12680 2026-02-21T12:17:21.374 INFO:tasks.workunit.client.0.trial058.stdout:Min IOPS: 84 2026-02-21T12:17:21.374 INFO:tasks.workunit.client.0.trial058.stdout:Average Latency(s): 0.00191853 2026-02-21T12:17:21.374 INFO:tasks.workunit.client.0.trial058.stdout:Stddev Latency(s): 0.00835726 2026-02-21T12:17:21.374 INFO:tasks.workunit.client.0.trial058.stdout:Max latency(s): 0.246055 2026-02-21T12:17:21.374 INFO:tasks.workunit.client.0.trial058.stdout:Min latency(s): 0.000410199 2026-02-21T12:17:21.376 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 128520 2026-02-21T12:17:21.376 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: sleep 1 2026-02-21T12:17:22.377 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 128520 2026-02-21T12:17:22.378 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 158: kill: (128520) - No such process 2026-02-21T12:17:22.378 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:159: TEST_bluestore: ceph osd down 0 2026-02-21T12:17:22.606 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already down. 2026-02-21T12:17:22.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 129463 2026-02-21T12:17:22.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: sleep 1 2026-02-21T12:17:23.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 129463 2026-02-21T12:17:23.615 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 160: kill: (129463) - No such process 2026-02-21T12:17:23.615 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:161: TEST_bluestore: ceph osd down 1 2026-02-21T12:17:23.841 INFO:tasks.workunit.client.0.trial058.stderr:osd.1 is already down. 2026-02-21T12:17:23.848 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 130403 2026-02-21T12:17:23.848 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: sleep 1 2026-02-21T12:17:24.850 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 130403 2026-02-21T12:17:24.850 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 162: kill: (130403) - No such process 2026-02-21T12:17:24.850 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:163: TEST_bluestore: ceph osd down 2 2026-02-21T12:17:25.078 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already down. 2026-02-21T12:17:25.087 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 131338 2026-02-21T12:17:25.087 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: sleep 1 2026-02-21T12:17:26.088 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 131338 2026-02-21T12:17:26.088 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 164: kill: (131338) - No such process 2026-02-21T12:17:26.088 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:165: TEST_bluestore: ceph osd down 3 2026-02-21T12:17:26.367 INFO:tasks.workunit.client.0.trial058.stderr:osd.3 is already down. 2026-02-21T12:17:26.375 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:168: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-21T12:17:29.225 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:17:29.265 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:170: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal count=512 bs=1M 2026-02-21T12:17:29.480 INFO:tasks.workunit.client.0.trial058.stderr:512+0 records in 2026-02-21T12:17:29.481 INFO:tasks.workunit.client.0.trial058.stderr:512+0 records out 2026-02-21T12:17:29.481 INFO:tasks.workunit.client.0.trial058.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.214612 s, 2.5 GB/s 2026-02-21T12:17:29.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:171: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --dev-target td/osd-bluefs-volume-ops/0/wal --command bluefs-bdev-new-wal 2026-02-21T12:17:29.490 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:17:32.016 INFO:tasks.workunit.client.0.trial058.stdout:WAL device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal 2026-02-21T12:17:32.028 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:175: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-21T12:17:34.897 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:17:34.933 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:178: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-21T12:17:37.894 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:17:37.926 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:180: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db count=1024 bs=1M 2026-02-21T12:17:38.342 INFO:tasks.workunit.client.0.trial058.stderr:1024+0 records in 2026-02-21T12:17:38.342 INFO:tasks.workunit.client.0.trial058.stderr:1024+0 records out 2026-02-21T12:17:38.342 INFO:tasks.workunit.client.0.trial058.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.415187 s, 2.6 GB/s 2026-02-21T12:17:38.342 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:181: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --dev-target td/osd-bluefs-volume-ops/1/db --command bluefs-bdev-new-db 2026-02-21T12:17:38.351 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:17:41.690 INFO:tasks.workunit.client.0.trial058.stdout:DB device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db 2026-02-21T12:17:41.702 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:185: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block --dev-target td/osd-bluefs-volume-ops/1/block.db --command bluefs-bdev-migrate 2026-02-21T12:17:41.712 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:17:44.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:190: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-21T12:17:47.034 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:17:47.072 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:193: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-21T12:17:49.957 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:17:49.987 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:195: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-db 2026-02-21T12:17:49.998 INFO:tasks.workunit.client.0.trial058.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-21T12:17:49.998 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:17:52.342 INFO:tasks.workunit.client.0.trial058.stdout:DB device added 2026-02-21T12:17:52.358 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:198: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-wal 2026-02-21T12:17:52.368 INFO:tasks.workunit.client.0.trial058.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-21T12:17:52.368 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:17:54.587 INFO:tasks.workunit.client.0.trial058.stdout:WAL device added 2026-02-21T12:17:54.599 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:201: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/block.db --command bluefs-bdev-migrate 2026-02-21T12:17:54.609 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:17:57.435 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:206: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-21T12:18:00.355 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:18:00.385 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:209: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-21T12:18:03.200 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:18:03.233 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:211: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --command bluefs-bdev-new-wal 2026-02-21T12:18:03.242 INFO:tasks.workunit.client.0.trial058.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-21T12:18:03.242 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:18:05.374 INFO:tasks.workunit.client.0.trial058.stdout:WAL device added 2026-02-21T12:18:05.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:214: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-21T12:18:05.400 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:18:08.105 INFO:tasks.workunit.client.0.trial058.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block.db 2026-02-21T12:18:08.125 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:219: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-21T12:18:10.890 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:221: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:18:10.927 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:18:10.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-21T12:18:10.929 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-21T12:18:10.929 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:18:10.929 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:18:10.930 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-21T12:18:10.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-21T12:18:10.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:18:10.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:18:10.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:18:10.943 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:10.954+0000 7f556080f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:18:10.945 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:10.956+0000 7f556080f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:18:10.945 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:10.957+0000 7f556080f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:18:11.106 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:11.117+0000 7f556080f780 -1 Falling back to public interface 2026-02-21T12:18:11.160 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-21T12:18:11.160 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:18:11.160 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:18:11.160 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:18:11.160 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:18:11.160 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:11.160 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:18:11.161 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:18:11.161 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:11.161 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:18:11.384 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:12.385 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:12.385 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:12.386 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:18:12.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:18:12.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:12.386 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:18:12.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:13.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:13.615 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:13.615 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:18:13.616 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:18:13.616 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:13.616 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:18:13.843 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:14.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:14.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:14.845 INFO:tasks.workunit.client.0.trial058.stdout:3 2026-02-21T12:18:14.846 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-21T12:18:14.846 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:14.846 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:18:15.077 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:16.078 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:16.078 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:16.079 INFO:tasks.workunit.client.0.trial058.stdout:4 2026-02-21T12:18:16.079 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-21T12:18:16.080 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:16.080 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:18:16.309 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:16.747 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:16.758+0000 7f556080f780 -1 osd.0 44 log_to_monitors true 2026-02-21T12:18:17.311 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:17.311 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:17.311 INFO:tasks.workunit.client.0.trial058.stdout:5 2026-02-21T12:18:17.312 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-21T12:18:17.312 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:17.312 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:18:17.541 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 52 up_thru 52 down_at 44 last_clean_interval [30,44) [v2:127.0.0.1:6800/3662933963,v1:127.0.0.1:6801/3662933963] [v2:127.0.0.1:6802/3662933963,v1:127.0.0.1:6803/3662933963] exists,up 950bc319-8879-4c2d-b18b-2509ee8724fa 2026-02-21T12:18:17.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:18:17.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:18:17.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:18:17.542 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: osd_pid0=138807 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:223: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:18:17.543 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:18:17.544 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:18:17.544 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:18:17.544 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:18:17.544 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:18:17.544 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:18:17.544 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:18:17.544 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:18:17.544 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:18:17.545 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:18:17.546 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-21T12:18:17.546 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-21T12:18:17.547 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:18:17.547 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:18:17.547 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:18:17.560 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:17.571+0000 7fe8eb83b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:18:17.561 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:17.573+0000 7fe8eb83b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:18:17.562 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:17.573+0000 7fe8eb83b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:18:17.734 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:17.746+0000 7fe8eb83b780 -1 Falling back to public interface 2026-02-21T12:18:17.777 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-21T12:18:17.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:18:17.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:18:17.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:18:17.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:18:17.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:17.778 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:18:17.779 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:18:17.779 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:17.779 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:18:18.006 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:19.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:19.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:19.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:18:19.009 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:18:19.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:19.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:18:19.240 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:20.241 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:20.241 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:20.241 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:18:20.241 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:18:20.241 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:20.241 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:18:20.472 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:21.473 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:21.473 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:21.474 INFO:tasks.workunit.client.0.trial058.stdout:3 2026-02-21T12:18:21.474 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-21T12:18:21.474 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:21.475 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:18:21.701 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:22.702 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:22.702 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:22.703 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-21T12:18:22.703 INFO:tasks.workunit.client.0.trial058.stdout:4 2026-02-21T12:18:22.703 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:22.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:18:22.936 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:23.587 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:23.598+0000 7fe8eb83b780 -1 osd.1 45 log_to_monitors true 2026-02-21T12:18:23.937 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:23.937 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:23.938 INFO:tasks.workunit.client.0.trial058.stdout:5 2026-02-21T12:18:23.938 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-21T12:18:23.938 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:23.939 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:18:24.170 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 46 last_clean_interval [34,45) [v2:127.0.0.1:6810/788893536,v1:127.0.0.1:6811/788893536] [v2:127.0.0.1:6812/788893536,v1:127.0.0.1:6813/788893536] exists,up 2fe7c6b6-11f6-40d3-b860-a039bbd5c5e5 2026-02-21T12:18:24.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:18:24.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:18:24.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:18:24.171 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-21T12:18:24.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: osd_pid1=139829 2026-02-21T12:18:24.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:225: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-21T12:18:24.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:18:24.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:18:24.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-21T12:18:24.175 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:18:24.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-21T12:18:24.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:18:24.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:18:24.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:18:24.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:18:24.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-21T12:18:24.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-21T12:18:24.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:18:24.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:18:24.176 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:18:24.176 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:18:24.176 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:18:24.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:18:24.178 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:18:24.178 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:18:24.178 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-21T12:18:24.178 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-21T12:18:24.178 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:18:24.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:18:24.179 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-21T12:18:24.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-21T12:18:24.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:18:24.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:18:24.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:18:24.188 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:24.199+0000 7f39d0616780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:18:24.189 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:24.201+0000 7f39d0616780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:18:24.190 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:24.201+0000 7f39d0616780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:18:24.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-21T12:18:24.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:18:24.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:18:24.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:18:24.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:18:24.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:24.404 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:18:24.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:18:24.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:24.405 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:18:24.432 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:24.443+0000 7f39d0616780 -1 Falling back to public interface 2026-02-21T12:18:24.630 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:25.631 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:25.632 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:25.632 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:18:25.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:18:25.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:25.633 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:18:25.859 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:26.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:26.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:26.860 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:18:26.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:18:26.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:26.860 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:18:27.089 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:28.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:28.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:28.090 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-21T12:18:28.090 INFO:tasks.workunit.client.0.trial058.stdout:3 2026-02-21T12:18:28.091 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:28.091 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:18:28.326 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:29.328 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:29.328 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:29.328 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-21T12:18:29.329 INFO:tasks.workunit.client.0.trial058.stdout:4 2026-02-21T12:18:29.329 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:29.329 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:18:29.562 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:30.173 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:30.184+0000 7f39d0616780 -1 osd.2 47 log_to_monitors true 2026-02-21T12:18:30.563 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:30.563 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:30.564 INFO:tasks.workunit.client.0.trial058.stdout:5 2026-02-21T12:18:30.564 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-21T12:18:30.564 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:30.564 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:18:30.790 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 58 up_thru 58 down_at 48 last_clean_interval [38,47) [v2:127.0.0.1:6818/3453779457,v1:127.0.0.1:6819/3453779457] [v2:127.0.0.1:6820/3453779457,v1:127.0.0.1:6821/3453779457] exists,up 0dd91019-62fc-41dd-93d2-b1eee4107630 2026-02-21T12:18:30.790 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:18:30.790 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:18:30.790 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:18:30.791 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-21T12:18:30.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: osd_pid2=140850 2026-02-21T12:18:30.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:227: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-21T12:18:30.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:18:30.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:18:30.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-21T12:18:30.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:18:30.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-21T12:18:30.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:18:30.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:18:30.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:18:30.792 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:18:30.793 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-21T12:18:30.793 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-21T12:18:30.793 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:18:30.793 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:18:30.793 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:18:30.793 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:18:30.793 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:18:30.793 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-21T12:18:30.794 INFO:tasks.workunit.client.0.trial058.stdout:start osd.3 2026-02-21T12:18:30.795 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:18:30.795 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-21T12:18:30.795 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-21T12:18:30.795 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:18:30.796 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:18:30.796 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:18:30.808 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:30.819+0000 7f1e0a471780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:18:30.810 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:30.821+0000 7f1e0a471780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:18:30.811 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:30.822+0000 7f1e0a471780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:18:30.994 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:31.005+0000 7f1e0a471780 -1 Falling back to public interface 2026-02-21T12:18:31.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-21T12:18:31.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:18:31.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-21T12:18:31.021 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:18:31.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:18:31.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:31.022 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:18:31.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:18:31.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:31.022 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:18:31.247 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:32.248 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:32.248 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:32.249 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:18:32.249 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:18:32.250 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:32.250 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:18:32.479 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:33.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:33.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:33.481 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:18:33.482 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:18:33.482 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:33.482 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:18:33.710 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:34.711 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:34.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:34.712 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-21T12:18:34.712 INFO:tasks.workunit.client.0.trial058.stdout:3 2026-02-21T12:18:34.713 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:34.713 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:18:34.939 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:35.939 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:35.939 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:35.939 INFO:tasks.workunit.client.0.trial058.stdout:4 2026-02-21T12:18:35.940 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-21T12:18:35.940 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:35.940 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:18:36.171 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:18:36.390 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:18:36.401+0000 7f1e0a471780 -1 osd.3 49 log_to_monitors true 2026-02-21T12:18:37.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:18:37.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:18:37.172 INFO:tasks.workunit.client.0.trial058.stdout:5 2026-02-21T12:18:37.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-21T12:18:37.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:18:37.172 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:18:37.395 INFO:tasks.workunit.client.0.trial058.stdout:osd.3 up in weight 1 up_from 61 up_thru 61 down_at 50 last_clean_interval [42,49) [v2:127.0.0.1:6826/3155336627,v1:127.0.0.1:6827/3155336627] [v2:127.0.0.1:6828/3155336627,v1:127.0.0.1:6829/3155336627] exists,up 662140bc-0fd0-471c-b964-5adc0bb2aa18 2026-02-21T12:18:37.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:18:37.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:18:37.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:18:37.397 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-21T12:18:37.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: osd_pid3=141870 2026-02-21T12:18:37.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:231: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-21T12:18:37.413 INFO:tasks.workunit.client.0.trial058.stdout:hints = 1 2026-02-21T12:18:37.413 INFO:tasks.workunit.client.0.trial058.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-21T12:18:37.413 INFO:tasks.workunit.client.0.trial058.stdout:Object prefix: benchmark_data_trial058_142870 2026-02-21T12:18:37.414 INFO:tasks.workunit.client.0.trial058.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-21T12:18:37.414 INFO:tasks.workunit.client.0.trial058.stdout: 0 0 0 0 0 0 - 0 2026-02-21T12:18:38.413 INFO:tasks.workunit.client.0.trial058.stdout: 1 16 12094 12078 47.176 47.1797 0.00120112 0.00132299 2026-02-21T12:18:39.413 INFO:tasks.workunit.client.0.trial058.stdout: 2 16 23650 23634 46.1565 45.1406 0.00104907 0.00135148 2026-02-21T12:18:40.414 INFO:tasks.workunit.client.0.trial058.stdout: 3 16 35297 35281 45.9351 45.4961 0.000960842 0.00135906 2026-02-21T12:18:41.414 INFO:tasks.workunit.client.0.trial058.stdout: 4 16 46806 46790 45.6898 44.957 0.00106952 0.00136649 2026-02-21T12:18:42.413 INFO:tasks.workunit.client.0.trial058.stdout: 5 16 58332 58316 45.5558 45.0234 0.00102104 0.00137048 2026-02-21T12:18:43.414 INFO:tasks.workunit.client.0.trial058.stdout: 6 16 69761 69745 45.4033 44.6445 0.00154145 0.00137527 2026-02-21T12:18:44.414 INFO:tasks.workunit.client.0.trial058.stdout: 7 16 76841 76825 42.8677 27.6562 0.00112033 0.00145664 2026-02-21T12:18:45.414 INFO:tasks.workunit.client.0.trial058.stdout: 8 16 88338 88322 43.1226 44.9102 0.00148588 0.00144799 2026-02-21T12:18:46.414 INFO:tasks.workunit.client.0.trial058.stdout: 9 16 99759 99743 43.2878 44.6133 0.000903043 0.00144239 2026-02-21T12:18:47.414 INFO:tasks.workunit.client.0.trial058.stdout: 10 16 111226 111210 43.4375 44.793 0.000867035 0.00143752 2026-02-21T12:18:48.414 INFO:tasks.workunit.client.0.trial058.stdout: 11 16 122201 122185 43.3857 42.8711 0.00142739 0.00143927 2026-02-21T12:18:49.414 INFO:tasks.workunit.client.0.trial058.stdout: 12 16 132945 132929 43.2674 41.9688 0.00555338 0.00143969 2026-02-21T12:18:50.415 INFO:tasks.workunit.client.0.trial058.stdout: 13 16 133054 133038 39.972 0.425781 0.0967744 0.00155217 2026-02-21T12:18:51.415 INFO:tasks.workunit.client.0.trial058.stdout: 14 16 136980 136964 38.2122 15.3359 0.000950272 0.00163434 2026-02-21T12:18:52.415 INFO:tasks.workunit.client.0.trial058.stdout: 15 16 147754 147738 38.4702 42.0859 0.00142435 0.00162334 2026-02-21T12:18:53.415 INFO:tasks.workunit.client.0.trial058.stdout: 16 16 158527 158511 38.6958 42.082 0.00124883 0.00161388 2026-02-21T12:18:54.415 INFO:tasks.workunit.client.0.trial058.stdout: 17 16 169212 169196 38.8745 41.7383 0.00143928 0.00160644 2026-02-21T12:18:55.415 INFO:tasks.workunit.client.0.trial058.stdout: 18 16 180072 180056 39.0714 42.4219 0.00139477 0.00159835 2026-02-21T12:18:56.415 INFO:tasks.workunit.client.0.trial058.stdout: 19 16 190969 190953 39.2552 42.5664 0.00114035 0.00159083 2026-02-21T12:18:57.415 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:18:57.427213+0000 min lat: 0.000419627 max lat: 0.205331 avg lat: 0.0016561 2026-02-21T12:18:57.415 INFO:tasks.workunit.client.0.trial058.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-21T12:18:57.415 INFO:tasks.workunit.client.0.trial058.stdout: 20 16 192597 192581 37.6104 6.35938 0.0973517 0.0016561 2026-02-21T12:18:58.415 INFO:tasks.workunit.client.0.trial058.stdout: 21 16 199861 199845 37.1705 28.375 0.002375 0.00168016 2026-02-21T12:18:59.415 INFO:tasks.workunit.client.0.trial058.stdout: 22 15 210706 210691 37.4066 42.3672 0.00174176 0.00166956 2026-02-21T12:19:00.415 INFO:tasks.workunit.client.0.trial058.stdout: 23 16 221429 221413 37.601 41.8828 0.000999203 0.0016609 2026-02-21T12:19:01.415 INFO:tasks.workunit.client.0.trial058.stdout: 24 16 232306 232290 37.8045 42.4883 0.00129247 0.00165197 2026-02-21T12:19:02.415 INFO:tasks.workunit.client.0.trial058.stdout: 25 16 243155 243139 37.9874 42.3789 0.00125127 0.00164401 2026-02-21T12:19:03.415 INFO:tasks.workunit.client.0.trial058.stdout: 26 16 251550 251534 37.7875 32.793 0.0913487 0.00164693 2026-02-21T12:19:04.415 INFO:tasks.workunit.client.0.trial058.stdout: 27 16 251670 251654 36.4053 0.46875 0.120026 0.00171342 2026-02-21T12:19:05.415 INFO:tasks.workunit.client.0.trial058.stdout: 28 16 251767 251751 35.1187 0.378906 0.164756 0.00177343 2026-02-21T12:19:06.416 INFO:tasks.workunit.client.0.trial058.stdout: 29 16 261127 261111 35.1684 36.5625 0.0014877 0.00177591 2026-02-21T12:19:07.416 INFO:tasks.workunit.client.0.trial058.stdout:Total time run: 30.0009 2026-02-21T12:19:07.416 INFO:tasks.workunit.client.0.trial058.stdout:Total writes made: 271574 2026-02-21T12:19:07.416 INFO:tasks.workunit.client.0.trial058.stdout:Write size: 4096 2026-02-21T12:19:07.416 INFO:tasks.workunit.client.0.trial058.stdout:Object size: 4096 2026-02-21T12:19:07.416 INFO:tasks.workunit.client.0.trial058.stdout:Bandwidth (MB/sec): 35.3601 2026-02-21T12:19:07.416 INFO:tasks.workunit.client.0.trial058.stdout:Stddev Bandwidth: 15.1409 2026-02-21T12:19:07.417 INFO:tasks.workunit.client.0.trial058.stdout:Max bandwidth (MB/sec): 47.1797 2026-02-21T12:19:07.417 INFO:tasks.workunit.client.0.trial058.stdout:Min bandwidth (MB/sec): 0.378906 2026-02-21T12:19:07.417 INFO:tasks.workunit.client.0.trial058.stdout:Average IOPS: 9052 2026-02-21T12:19:07.417 INFO:tasks.workunit.client.0.trial058.stdout:Stddev IOPS: 3876.08 2026-02-21T12:19:07.417 INFO:tasks.workunit.client.0.trial058.stdout:Max IOPS: 12078 2026-02-21T12:19:07.417 INFO:tasks.workunit.client.0.trial058.stdout:Min IOPS: 97 2026-02-21T12:19:07.417 INFO:tasks.workunit.client.0.trial058.stdout:Average Latency(s): 0.00176629 2026-02-21T12:19:07.417 INFO:tasks.workunit.client.0.trial058.stdout:Stddev Latency(s): 0.00668504 2026-02-21T12:19:07.417 INFO:tasks.workunit.client.0.trial058.stdout:Max latency(s): 0.237142 2026-02-21T12:19:07.417 INFO:tasks.workunit.client.0.trial058.stdout:Min latency(s): 0.000419627 2026-02-21T12:19:07.418 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 138807 2026-02-21T12:19:07.418 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: sleep 1 2026-02-21T12:19:08.420 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 138807 2026-02-21T12:19:08.420 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 234: kill: (138807) - No such process 2026-02-21T12:19:08.420 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:235: TEST_bluestore: ceph osd down 0 2026-02-21T12:19:08.650 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already down. 2026-02-21T12:19:08.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 139829 2026-02-21T12:19:08.657 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: sleep 1 2026-02-21T12:19:09.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 139829 2026-02-21T12:19:09.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 236: kill: (139829) - No such process 2026-02-21T12:19:09.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:237: TEST_bluestore: ceph osd down 1 2026-02-21T12:19:09.889 INFO:tasks.workunit.client.0.trial058.stderr:osd.1 is already down. 2026-02-21T12:19:09.897 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 140850 2026-02-21T12:19:09.897 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: sleep 1 2026-02-21T12:19:10.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 140850 2026-02-21T12:19:10.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 238: kill: (140850) - No such process 2026-02-21T12:19:10.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:239: TEST_bluestore: ceph osd down 2 2026-02-21T12:19:11.131 INFO:tasks.workunit.client.0.trial058.stderr:osd.2 is already down. 2026-02-21T12:19:11.139 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 141870 2026-02-21T12:19:11.139 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: sleep 1 2026-02-21T12:19:12.140 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 141870 2026-02-21T12:19:12.140 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 240: kill: (141870) - No such process 2026-02-21T12:19:12.140 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:241: TEST_bluestore: ceph osd down 3 2026-02-21T12:19:12.416 INFO:tasks.workunit.client.0.trial058.stderr:osd.3 is already down. 2026-02-21T12:19:12.423 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:244: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-21T12:19:16.342 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:19:16.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:246: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/db2 count=1024 bs=1M 2026-02-21T12:19:16.823 INFO:tasks.workunit.client.0.trial058.stderr:1024+0 records in 2026-02-21T12:19:16.824 INFO:tasks.workunit.client.0.trial058.stderr:1024+0 records out 2026-02-21T12:19:16.824 INFO:tasks.workunit.client.0.trial058.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.427103 s, 2.5 GB/s 2026-02-21T12:19:16.824 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:247: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/db2 --command bluefs-bdev-migrate 2026-02-21T12:19:16.835 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:19:20.582 INFO:tasks.workunit.client.0.trial058.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-21T12:19:20.583 INFO:tasks.workunit.client.0.trial058.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/db2 2026-02-21T12:19:20.601 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:252: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-21T12:19:24.480 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:19:24.525 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:256: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal2 count=512 bs=1M 2026-02-21T12:19:24.740 INFO:tasks.workunit.client.0.trial058.stderr:512+0 records in 2026-02-21T12:19:24.741 INFO:tasks.workunit.client.0.trial058.stderr:512+0 records out 2026-02-21T12:19:24.741 INFO:tasks.workunit.client.0.trial058.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.214657 s, 2.5 GB/s 2026-02-21T12:19:24.741 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:257: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/wal2 --command bluefs-bdev-migrate 2026-02-21T12:19:24.751 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:19:28.377 INFO:tasks.workunit.client.0.trial058.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-21T12:19:28.377 INFO:tasks.workunit.client.0.trial058.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal2 2026-02-21T12:19:28.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:261: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/0/wal 2026-02-21T12:19:28.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:263: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-21T12:19:32.364 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:19:32.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:266: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-21T12:19:35.845 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:19:35.893 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:268: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db2 count=1024 bs=1M 2026-02-21T12:19:36.314 INFO:tasks.workunit.client.0.trial058.stderr:1024+0 records in 2026-02-21T12:19:36.314 INFO:tasks.workunit.client.0.trial058.stderr:1024+0 records out 2026-02-21T12:19:36.314 INFO:tasks.workunit.client.0.trial058.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.41923 s, 2.6 GB/s 2026-02-21T12:19:36.314 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:269: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --devs-source td/osd-bluefs-volume-ops/1/block.wal --dev-target td/osd-bluefs-volume-ops/1/db2 --command bluefs-bdev-migrate 2026-02-21T12:19:36.324 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:19:40.032 INFO:tasks.workunit.client.0.trial058.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-21T12:19:40.032 INFO:tasks.workunit.client.0.trial058.stdout: device removed:0 td/osd-bluefs-volume-ops/1/block.wal 2026-02-21T12:19:40.032 INFO:tasks.workunit.client.0.trial058.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db2 2026-02-21T12:19:40.052 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:275: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db 2026-02-21T12:19:40.187 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:277: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-21T12:19:43.604 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:19:43.658 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:279: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-21T12:19:43.668 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:19:46.555 INFO:tasks.workunit.client.0.trial058.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-21T12:19:46.573 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:284: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db2 2026-02-21T12:19:46.701 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:286: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-21T12:19:50.053 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:19:50.101 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:289: TEST_bluestore: ceph-objectstore-tool --type bluestore --data-path td/osd-bluefs-volume-ops/2 --op fsck --no-mon-config 2026-02-21T12:19:53.312 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:19:53.362 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:292: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-21T12:19:53.795 INFO:tasks.workunit.client.0.trial058.stderr:1024+0 records in 2026-02-21T12:19:53.795 INFO:tasks.workunit.client.0.trial058.stderr:1024+0 records out 2026-02-21T12:19:53.795 INFO:tasks.workunit.client.0.trial058.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.431401 s, 2.5 GB/s 2026-02-21T12:19:53.795 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:293: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-21T12:19:53.804 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:19:53.860 INFO:tasks.workunit.client.0.trial058.stderr:Unable to migrate Slow volume to new location, please allocate new DB or WAL with --bluefs-bdev-new-db(wal) command 2026-02-21T12:19:53.862 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:299: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-21T12:19:53.863 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:302: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-21T12:19:57.107 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:19:57.149 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:305: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-21T12:19:58.429 INFO:tasks.workunit.client.0.trial058.stderr:1024+0 records in 2026-02-21T12:19:58.429 INFO:tasks.workunit.client.0.trial058.stderr:1024+0 records out 2026-02-21T12:19:58.429 INFO:tasks.workunit.client.0.trial058.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 1.13554 s, 946 MB/s 2026-02-21T12:19:58.429 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:307: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --devs-source td/osd-bluefs-volume-ops/2/block.db --devs-source td/osd-bluefs-volume-ops/2/block.wal --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-21T12:19:58.438 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:20:01.237 INFO:tasks.workunit.client.0.trial058.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-21T12:20:01.238 INFO:tasks.workunit.client.0.trial058.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-21T12:20:01.238 INFO:tasks.workunit.client.0.trial058.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/2/db2 2026-02-21T12:20:01.260 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:314: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-21T12:20:04.411 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:20:04.453 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:317: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/3/wal2 count=1024 bs=1M 2026-02-21T12:20:04.869 INFO:tasks.workunit.client.0.trial058.stderr:1024+0 records in 2026-02-21T12:20:04.870 INFO:tasks.workunit.client.0.trial058.stderr:1024+0 records out 2026-02-21T12:20:04.870 INFO:tasks.workunit.client.0.trial058.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.415506 s, 2.6 GB/s 2026-02-21T12:20:04.870 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:319: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/wal2 --command bluefs-bdev-migrate 2026-02-21T12:20:04.880 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:20:08.375 INFO:tasks.workunit.client.0.trial058.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block 2026-02-21T12:20:08.375 INFO:tasks.workunit.client.0.trial058.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-21T12:20:08.375 INFO:tasks.workunit.client.0.trial058.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/3/wal2 2026-02-21T12:20:08.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:325: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-21T12:20:11.615 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:20:11.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:327: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-21T12:20:11.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:20:11.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:20:11.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-21T12:20:11.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:20:11.665 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-21T12:20:11.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:20:11.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:20:11.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:20:11.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:20:11.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-21T12:20:11.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-21T12:20:11.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:20:11.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:20:11.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:20:11.666 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:20:11.666 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:20:11.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:20:11.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:20:11.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:20:11.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-21T12:20:11.668 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-21T12:20:11.668 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:20:11.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:20:11.669 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-21T12:20:11.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-21T12:20:11.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:20:11.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:20:11.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:20:11.679 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:11.689+0000 7f8b4c42c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:20:11.681 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:11.691+0000 7f8b4c42c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:20:11.681 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:11.692+0000 7f8b4c42c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:20:11.837 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:11.847+0000 7f8b4c42c780 -1 Falling back to public interface 2026-02-21T12:20:11.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-21T12:20:11.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:20:11.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:20:11.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:20:11.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:20:11.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:11.896 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:20:11.897 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:20:11.897 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:11.898 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:20:12.125 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:13.126 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:13.126 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:13.126 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:20:13.126 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:20:13.127 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:13.127 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:20:13.356 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:14.358 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:14.358 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:14.358 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:20:14.358 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:20:14.358 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:14.358 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:20:14.587 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:15.589 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:15.589 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:15.589 INFO:tasks.workunit.client.0.trial058.stdout:3 2026-02-21T12:20:15.590 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-21T12:20:15.591 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:15.591 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:20:15.824 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:16.825 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:16.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:16.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-21T12:20:16.826 INFO:tasks.workunit.client.0.trial058.stdout:4 2026-02-21T12:20:16.826 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:16.827 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:20:17.054 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:18.056 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:18.056 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:18.056 INFO:tasks.workunit.client.0.trial058.stdout:5 2026-02-21T12:20:18.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-21T12:20:18.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:18.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:20:18.284 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:19.154 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:19.165+0000 7f8b4c42c780 -1 osd.0 63 log_to_monitors true 2026-02-21T12:20:19.286 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:19.286 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:19.286 INFO:tasks.workunit.client.0.trial058.stdout:6 2026-02-21T12:20:19.287 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-21T12:20:19.287 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:19.287 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:20:19.520 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:20.521 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:20.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:20.522 INFO:tasks.workunit.client.0.trial058.stdout:7 2026-02-21T12:20:20.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-21T12:20:20.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:20.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:20:20.753 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 71 up_thru 71 down_at 63 last_clean_interval [52,63) [v2:127.0.0.1:6800/390186558,v1:127.0.0.1:6801/390186558] [v2:127.0.0.1:6802/390186558,v1:127.0.0.1:6803/390186558] exists,up 950bc319-8879-4c2d-b18b-2509ee8724fa 2026-02-21T12:20:20.753 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:20:20.754 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:20:20.754 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:20:20.754 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-21T12:20:20.758 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: osd_pid0=149045 2026-02-21T12:20:20.758 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:329: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-21T12:20:20.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:20:20.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:20:20.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-21T12:20:20.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:20:20.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-21T12:20:20.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:20:20.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:20:20.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:20:20.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:20:20.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-21T12:20:20.759 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:20:20.760 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:20:20.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:20:20.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:20:20.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:20:20.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:20:20.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:20:20.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:20:20.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:20:20.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-21T12:20:20.761 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-21T12:20:20.762 INFO:tasks.workunit.client.0.trial058.stdout:start osd.1 2026-02-21T12:20:20.762 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:20:20.763 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-21T12:20:20.763 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-21T12:20:20.763 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:20:20.763 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:20:20.763 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:20:20.771 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:20.781+0000 7fc08a053780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:20:20.772 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:20.783+0000 7fc08a053780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:20:20.773 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:20.784+0000 7fc08a053780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:20:20.952 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:20.963+0000 7fc08a053780 -1 Falling back to public interface 2026-02-21T12:20:20.989 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-21T12:20:20.989 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:20:20.989 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-21T12:20:20.990 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:20:20.990 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:20:20.990 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:20.990 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:20:20.990 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:20:20.991 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:20.991 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:20:21.213 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:22.214 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:22.215 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:22.215 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:20:22.215 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:20:22.215 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:22.215 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:20:22.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:23.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:23.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:23.447 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:20:23.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:20:23.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:23.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:20:23.676 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:24.677 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:24.677 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:24.677 INFO:tasks.workunit.client.0.trial058.stdout:3 2026-02-21T12:20:24.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-21T12:20:24.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:24.678 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:20:24.909 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:25.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:25.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:25.910 INFO:tasks.workunit.client.0.trial058.stdout:4 2026-02-21T12:20:25.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-21T12:20:25.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:25.910 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:20:26.139 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:27.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:27.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:27.141 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-21T12:20:27.142 INFO:tasks.workunit.client.0.trial058.stdout:5 2026-02-21T12:20:27.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:27.142 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:20:27.329 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:27.339+0000 7fc08a053780 -1 osd.1 64 log_to_monitors true 2026-02-21T12:20:27.375 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:28.376 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:28.377 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:28.377 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-21T12:20:28.377 INFO:tasks.workunit.client.0.trial058.stdout:6 2026-02-21T12:20:28.378 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:28.378 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-21T12:20:28.603 INFO:tasks.workunit.client.0.trial058.stdout:osd.1 up in weight 1 up_from 74 up_thru 74 down_at 65 last_clean_interval [55,64) [v2:127.0.0.1:6810/2946053788,v1:127.0.0.1:6811/2946053788] [v2:127.0.0.1:6812/2946053788,v1:127.0.0.1:6813/2946053788] exists,up 2fe7c6b6-11f6-40d3-b860-a039bbd5c5e5 2026-02-21T12:20:28.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:20:28.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:20:28.604 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:20:28.604 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-21T12:20:28.608 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: osd_pid1=150116 2026-02-21T12:20:28.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:331: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-21T12:20:28.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:20:28.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:20:28.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-21T12:20:28.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:20:28.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-21T12:20:28.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:20:28.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:20:28.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:20:28.609 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:20:28.610 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-21T12:20:28.610 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-21T12:20:28.610 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:20:28.610 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:20:28.610 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:20:28.610 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:20:28.610 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:20:28.610 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:20:28.610 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:20:28.610 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:20:28.610 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:20:28.610 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:20:28.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:20:28.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:20:28.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:20:28.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:20:28.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:20:28.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:20:28.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:20:28.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:20:28.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:20:28.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:20:28.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-21T12:20:28.611 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-21T12:20:28.612 INFO:tasks.workunit.client.0.trial058.stdout:start osd.2 2026-02-21T12:20:28.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:20:28.613 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-21T12:20:28.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-21T12:20:28.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:20:28.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:20:28.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:20:28.621 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:28.632+0000 7fead93fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:20:28.622 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:28.633+0000 7fead93fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:20:28.623 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:28.634+0000 7fead93fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:20:28.785 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:28.796+0000 7fead93fd780 -1 Falling back to public interface 2026-02-21T12:20:28.835 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-21T12:20:28.835 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:20:28.835 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-21T12:20:28.835 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:20:28.835 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:20:28.835 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:28.835 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:20:28.835 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:20:28.836 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:28.836 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:20:29.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:30.058 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:30.058 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:30.059 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:20:30.059 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:20:30.060 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:30.060 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:20:30.289 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:31.290 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:31.290 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:31.290 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:20:31.291 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:20:31.291 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:31.291 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:20:31.520 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:32.521 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:32.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:32.522 INFO:tasks.workunit.client.0.trial058.stdout:3 2026-02-21T12:20:32.522 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-21T12:20:32.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:32.523 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:20:32.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:33.751 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:33.751 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:33.751 INFO:tasks.workunit.client.0.trial058.stdout:4 2026-02-21T12:20:33.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-21T12:20:33.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:33.752 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:20:33.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:34.692 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:34.702+0000 7fead93fd780 -1 osd.2 66 log_to_monitors true 2026-02-21T12:20:34.985 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:34.985 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:34.986 INFO:tasks.workunit.client.0.trial058.stdout:5 2026-02-21T12:20:34.986 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-21T12:20:34.986 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:34.987 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-21T12:20:35.212 INFO:tasks.workunit.client.0.trial058.stdout:osd.2 up in weight 1 up_from 78 up_thru 78 down_at 67 last_clean_interval [58,66) [v2:127.0.0.1:6818/3300125943,v1:127.0.0.1:6819/3300125943] [v2:127.0.0.1:6820/3300125943,v1:127.0.0.1:6821/3300125943] exists,up 0dd91019-62fc-41dd-93d2-b1eee4107630 2026-02-21T12:20:35.213 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:20:35.213 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:20:35.213 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:20:35.214 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-21T12:20:35.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: osd_pid2=151151 2026-02-21T12:20:35.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:333: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-21T12:20:35.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:20:35.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:20:35.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-21T12:20:35.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:20:35.217 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:20:35.218 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:20:35.219 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-21T12:20:35.219 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-21T12:20:35.219 INFO:tasks.workunit.client.0.trial058.stdout:start osd.3 2026-02-21T12:20:35.219 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:20:35.219 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-21T12:20:35.219 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-21T12:20:35.219 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:20:35.219 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:20:35.219 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:20:35.229 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:35.240+0000 7f6642e5a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:20:35.231 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:35.242+0000 7f6642e5a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:20:35.232 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:35.243+0000 7f6642e5a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:20:35.396 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:35.406+0000 7f6642e5a780 -1 Falling back to public interface 2026-02-21T12:20:35.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-21T12:20:35.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:20:35.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-21T12:20:35.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:20:35.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:20:35.445 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:35.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:20:35.446 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:20:35.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:35.446 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:20:35.672 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:36.673 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:36.673 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:36.673 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:20:36.674 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:20:36.674 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:36.674 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:20:36.904 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:37.906 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:37.906 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:37.906 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:20:37.906 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:20:37.907 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:37.907 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:20:38.137 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:39.138 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:39.138 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:39.138 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-21T12:20:39.138 INFO:tasks.workunit.client.0.trial058.stdout:3 2026-02-21T12:20:39.139 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:39.139 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:20:39.366 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:40.367 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:40.368 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:40.368 INFO:tasks.workunit.client.0.trial058.stdout:4 2026-02-21T12:20:40.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-21T12:20:40.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:40.369 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:20:40.599 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:20:41.399 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:20:41.408+0000 7f6642e5a780 -1 osd.3 68 log_to_monitors true 2026-02-21T12:20:41.600 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:20:41.600 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:20:41.601 INFO:tasks.workunit.client.0.trial058.stdout:5 2026-02-21T12:20:41.601 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-21T12:20:41.601 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:20:41.602 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-21T12:20:41.830 INFO:tasks.workunit.client.0.trial058.stdout:osd.3 up in weight 1 up_from 81 up_thru 81 down_at 69 last_clean_interval [61,68) [v2:127.0.0.1:6826/2727365330,v1:127.0.0.1:6827/2727365330] [v2:127.0.0.1:6828/2727365330,v1:127.0.0.1:6829/2727365330] exists,up 662140bc-0fd0-471c-b964-5adc0bb2aa18 2026-02-21T12:20:41.831 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:20:41.831 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:20:41.831 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:20:41.831 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-21T12:20:41.832 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: osd_pid3=152166 2026-02-21T12:20:41.832 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:337: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-21T12:20:41.850 INFO:tasks.workunit.client.0.trial058.stdout:hints = 1 2026-02-21T12:20:41.850 INFO:tasks.workunit.client.0.trial058.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-21T12:20:41.850 INFO:tasks.workunit.client.0.trial058.stdout:Object prefix: benchmark_data_trial058_153167 2026-02-21T12:20:41.850 INFO:tasks.workunit.client.0.trial058.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-21T12:20:41.850 INFO:tasks.workunit.client.0.trial058.stdout: 0 0 0 0 0 0 - 0 2026-02-21T12:20:42.850 INFO:tasks.workunit.client.0.trial058.stdout: 1 16 12085 12069 47.1408 47.1445 0.00111477 0.00132111 2026-02-21T12:20:43.850 INFO:tasks.workunit.client.0.trial058.stdout: 2 15 24206 24191 47.2443 47.3516 0.00244931 0.00132127 2026-02-21T12:20:44.850 INFO:tasks.workunit.client.0.trial058.stdout: 3 16 35939 35923 46.7711 45.8281 0.00116542 0.00133474 2026-02-21T12:20:45.850 INFO:tasks.workunit.client.0.trial058.stdout: 4 16 48004 47988 46.8596 47.1289 0.00150111 0.00133236 2026-02-21T12:20:46.850 INFO:tasks.workunit.client.0.trial058.stdout: 5 16 60046 60030 46.8948 47.0391 0.00149465 0.00133141 2026-02-21T12:20:47.850 INFO:tasks.workunit.client.0.trial058.stdout: 6 16 72136 72120 46.9495 47.2266 0.000820844 0.00132982 2026-02-21T12:20:48.850 INFO:tasks.workunit.client.0.trial058.stdout: 7 16 84052 84036 46.8914 46.5469 0.000977235 0.00133154 2026-02-21T12:20:49.850 INFO:tasks.workunit.client.0.trial058.stdout: 8 16 96054 96038 46.8899 46.8828 0.000601457 0.00133144 2026-02-21T12:20:50.851 INFO:tasks.workunit.client.0.trial058.stdout: 9 15 107825 107810 46.7888 45.9844 0.00109981 0.00133444 2026-02-21T12:20:51.850 INFO:tasks.workunit.client.0.trial058.stdout: 10 16 119370 119354 46.619 45.0938 0.00110238 0.00133936 2026-02-21T12:20:52.851 INFO:tasks.workunit.client.0.trial058.stdout: 11 16 124148 124132 44.0775 18.6641 0.126901 0.00140794 2026-02-21T12:20:53.851 INFO:tasks.workunit.client.0.trial058.stdout: 12 16 124641 124625 40.5649 1.92578 0.00203903 0.00153945 2026-02-21T12:20:54.851 INFO:tasks.workunit.client.0.trial058.stdout: 13 15 136015 136000 40.8622 44.4336 0.000740816 0.0015282 2026-02-21T12:20:55.851 INFO:tasks.workunit.client.0.trial058.stdout: 14 15 147183 147168 41.0593 43.625 0.00124202 0.00152089 2026-02-21T12:20:56.851 INFO:tasks.workunit.client.0.trial058.stdout: 15 16 158394 158378 41.241 43.7891 0.00131774 0.00151415 2026-02-21T12:20:57.851 INFO:tasks.workunit.client.0.trial058.stdout: 16 16 169350 169334 41.3381 42.7969 0.00142199 0.00151061 2026-02-21T12:20:58.851 INFO:tasks.workunit.client.0.trial058.stdout: 17 16 180462 180446 41.4595 43.4062 0.00137534 0.00150621 2026-02-21T12:20:59.851 INFO:tasks.workunit.client.0.trial058.stdout: 18 16 181378 181362 39.355 3.57812 0.074047 0.0015829 2026-02-21T12:21:00.852 INFO:tasks.workunit.client.0.trial058.stdout: 19 16 190355 190339 39.1291 35.0664 0.00111109 0.001596 2026-02-21T12:21:01.852 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:21:01.862906+0000 min lat: 0.000421343 max lat: 0.19966 avg lat: 0.00158923 2026-02-21T12:21:01.852 INFO:tasks.workunit.client.0.trial058.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-21T12:21:01.852 INFO:tasks.workunit.client.0.trial058.stdout: 20 16 201224 201208 39.2954 42.457 0.0012528 0.00158923 2026-02-21T12:21:02.852 INFO:tasks.workunit.client.0.trial058.stdout: 21 16 212175 212159 39.461 42.7773 0.0013877 0.00158254 2026-02-21T12:21:03.852 INFO:tasks.workunit.client.0.trial058.stdout: 22 16 223133 223117 39.6128 42.8047 0.000907154 0.00157647 2026-02-21T12:21:04.852 INFO:tasks.workunit.client.0.trial058.stdout: 23 16 234243 234227 39.7773 43.3984 0.00295939 0.00156996 2026-02-21T12:21:05.852 INFO:tasks.workunit.client.0.trial058.stdout: 24 15 245230 245215 39.9082 42.9219 0.00164596 0.00156482 2026-02-21T12:21:06.852 INFO:tasks.workunit.client.0.trial058.stdout: 25 16 256341 256325 40.0476 43.3984 0.00167899 0.00155936 2026-02-21T12:21:07.852 INFO:tasks.workunit.client.0.trial058.stdout: 26 16 267270 267254 40.1492 42.6914 0.00190905 0.00155542 2026-02-21T12:21:08.852 INFO:tasks.workunit.client.0.trial058.stdout: 27 16 278221 278205 40.2464 42.7773 0.000880195 0.00155163 2026-02-21T12:21:09.852 INFO:tasks.workunit.client.0.trial058.stdout: 28 16 289011 288995 40.3142 42.1484 0.00115684 0.00154905 2026-02-21T12:21:10.853 INFO:tasks.workunit.client.0.trial058.stdout: 29 16 292572 292556 39.4037 13.9102 0.0786912 0.00158146 2026-02-21T12:21:11.852 INFO:tasks.workunit.client.0.trial058.stdout: 30 16 292700 292684 38.1069 0.5 0.120039 0.00163531 2026-02-21T12:21:12.853 INFO:tasks.workunit.client.0.trial058.stdout:Total time run: 30.1199 2026-02-21T12:21:12.853 INFO:tasks.workunit.client.0.trial058.stdout:Total writes made: 292700 2026-02-21T12:21:12.854 INFO:tasks.workunit.client.0.trial058.stdout:Write size: 4096 2026-02-21T12:21:12.854 INFO:tasks.workunit.client.0.trial058.stdout:Object size: 4096 2026-02-21T12:21:12.854 INFO:tasks.workunit.client.0.trial058.stdout:Bandwidth (MB/sec): 37.9602 2026-02-21T12:21:12.854 INFO:tasks.workunit.client.0.trial058.stdout:Stddev Bandwidth: 14.351 2026-02-21T12:21:12.854 INFO:tasks.workunit.client.0.trial058.stdout:Max bandwidth (MB/sec): 47.3516 2026-02-21T12:21:12.854 INFO:tasks.workunit.client.0.trial058.stdout:Min bandwidth (MB/sec): 0.5 2026-02-21T12:21:12.854 INFO:tasks.workunit.client.0.trial058.stdout:Average IOPS: 9717 2026-02-21T12:21:12.855 INFO:tasks.workunit.client.0.trial058.stdout:Stddev IOPS: 3673.85 2026-02-21T12:21:12.855 INFO:tasks.workunit.client.0.trial058.stdout:Max IOPS: 12122 2026-02-21T12:21:12.855 INFO:tasks.workunit.client.0.trial058.stdout:Min IOPS: 128 2026-02-21T12:21:12.855 INFO:tasks.workunit.client.0.trial058.stdout:Average Latency(s): 0.0016422 2026-02-21T12:21:12.855 INFO:tasks.workunit.client.0.trial058.stdout:Stddev Latency(s): 0.00523041 2026-02-21T12:21:12.855 INFO:tasks.workunit.client.0.trial058.stdout:Max latency(s): 0.205478 2026-02-21T12:21:12.855 INFO:tasks.workunit.client.0.trial058.stdout:Min latency(s): 0.000421343 2026-02-21T12:21:12.917 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:339: TEST_bluestore: wait_for_clean 2026-02-21T12:21:12.917 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:21:12.917 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:21:12.917 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:21:12.917 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-21T12:21:12.918 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:21:12.918 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:21:12.918 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:21:12.918 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:21:12.918 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:21:13.000 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-21T12:21:13.001 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:21:13.001 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:21:13.001 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:21:13.001 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:21:13.001 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:21:13.323 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids='0 2026-02-21T12:21:13.323 INFO:tasks.workunit.client.0.trial058.stderr:1 2026-02-21T12:21:13.324 INFO:tasks.workunit.client.0.trial058.stderr:2 2026-02-21T12:21:13.324 INFO:tasks.workunit.client.0.trial058.stderr:3' 2026-02-21T12:21:13.324 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:21:13.324 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:21:13.324 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:21:13.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=304942678029 2026-02-21T12:21:13.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 304942678029 2026-02-21T12:21:13.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-304942678029' 2026-02-21T12:21:13.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:21:13.387 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-21T12:21:13.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=317827579916 2026-02-21T12:21:13.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 317827579916 2026-02-21T12:21:13.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-304942678029 1-317827579916' 2026-02-21T12:21:13.449 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:21:13.450 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-21T12:21:13.555 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=335007449098 2026-02-21T12:21:13.555 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 335007449098 2026-02-21T12:21:13.555 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-304942678029 1-317827579916 2-335007449098' 2026-02-21T12:21:13.555 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:21:13.556 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-21T12:21:13.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=347892350985 2026-02-21T12:21:13.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 347892350985 2026-02-21T12:21:13.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-304942678029 1-317827579916 2-335007449098 3-347892350985' 2026-02-21T12:21:13.704 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:21:13.705 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-304942678029 2026-02-21T12:21:13.705 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:21:13.705 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:21:13.706 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-304942678029 2026-02-21T12:21:13.706 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:21:13.707 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=304942678029 2026-02-21T12:21:13.707 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 304942678029' 2026-02-21T12:21:13.707 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 304942678029 2026-02-21T12:21:13.708 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:21:13.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 304942678027 -lt 304942678029 2026-02-21T12:21:13.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:21:14.985 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:21:14.986 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:21:15.209 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 304942678030 -lt 304942678029 2026-02-21T12:21:15.209 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:21:15.209 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 1-317827579916 2026-02-21T12:21:15.209 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:21:15.210 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=1 2026-02-21T12:21:15.211 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 1-317827579916 2026-02-21T12:21:15.211 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:21:15.212 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=317827579916 2026-02-21T12:21:15.212 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.1 seq 317827579916' 2026-02-21T12:21:15.212 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.1 seq 317827579916 2026-02-21T12:21:15.213 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-21T12:21:15.439 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 317827579916 -lt 317827579916 2026-02-21T12:21:15.440 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:21:15.440 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 2-335007449098 2026-02-21T12:21:15.440 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:21:15.441 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=2 2026-02-21T12:21:15.442 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 2-335007449098 2026-02-21T12:21:15.442 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:21:15.443 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=335007449098 2026-02-21T12:21:15.443 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.2 seq 335007449098' 2026-02-21T12:21:15.443 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.2 seq 335007449098 2026-02-21T12:21:15.443 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-21T12:21:15.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 335007449099 -lt 335007449098 2026-02-21T12:21:15.666 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:21:15.667 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 3-347892350985 2026-02-21T12:21:15.667 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:21:15.667 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=3 2026-02-21T12:21:15.668 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 3-347892350985 2026-02-21T12:21:15.668 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:21:15.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=347892350985 2026-02-21T12:21:15.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.3 seq 347892350985' 2026-02-21T12:21:15.670 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.3 seq 347892350985 2026-02-21T12:21:15.670 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-21T12:21:15.893 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 347892350985 -lt 347892350985 2026-02-21T12:21:15.894 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:21:15.894 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:21:15.894 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:21:16.210 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-21T12:21:16.210 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:21:16.211 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:21:16.211 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:21:16.212 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:21:16.212 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:21:16.212 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:21:16.212 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:21:16.429 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-21T12:21:16.429 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:21:16.430 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:21:16.430 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:21:16.746 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-21T12:21:16.746 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:21:16.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:21:16.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-21T12:21:16.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:21:16.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:21:16.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-21T12:21:16.747 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:21:16.747 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:21:16.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:21:16.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:21:16.747 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:21:17.056 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:21:17.056 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:21:17.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:21:17.057 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:21:17.059 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:21:17.059 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:21:17.059 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:21:17.060 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:21:17.060 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:21:17.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:21:17.061 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:21:17.062 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:21:17.063 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:21:17.063 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-21T12:21:23.388 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:21:23.388 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:21:23.389 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:21:23.389 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108826 2026-02-21T12:21:23.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:21:23.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:21:23.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-21T12:21:23.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-21T12:21:23.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:21:23.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-21T12:21:23.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:21:23.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:21:23.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-21T12:21:23.391 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:21:23.391 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:21:23.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:21:23.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:21:23.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:21:23.392 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:21:23.392 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:21:23.393 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:21:23.393 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:21:23.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:21:23.394 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:21:23.394 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:21:23.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:21:23.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:21:23.395 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:21:23.396 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:21:23.396 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:21:23.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:21:23.397 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-21T12:21:23.398 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:21:23.398 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:21:23.398 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:21:23.399 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108826 2026-02-21T12:21:23.399 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:21:23.399 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:21:23.399 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-21T12:21:23.400 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-21T12:21:23.401 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:21:23.401 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:21:23.401 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.108826 2026-02-21T12:21:23.402 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-21T12:21:23.403 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-21T12:21:23.403 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-21T12:21:23.403 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-21T12:21:23.403 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore2 td/osd-bluefs-volume-ops 2026-02-21T12:21:23.403 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:343: TEST_bluestore2: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:21:23.403 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: ulimit -n 2026-02-21T12:21:23.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: local flimit=4096 2026-02-21T12:21:23.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:346: TEST_bluestore2: '[' 4096 -lt 1536 ']' 2026-02-21T12:21:23.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: export CEPH_MON=127.0.0.1:7146 2026-02-21T12:21:23.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: CEPH_MON=127.0.0.1:7146 2026-02-21T12:21:23.404 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:350: TEST_bluestore2: export CEPH_ARGS 2026-02-21T12:21:23.404 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: uuidgen 2026-02-21T12:21:23.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: CEPH_ARGS+='--fsid=03ed540f-f989-453b-9fa1-82051fd54a1c --auth-supported=none ' 2026-02-21T12:21:23.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:352: TEST_bluestore2: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-21T12:21:23.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:353: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-21T12:21:23.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:354: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-21T12:21:23.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:355: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-21T12:21:23.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:356: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-21T12:21:23.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:357: TEST_bluestore2: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-21T12:21:23.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:358: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-21T12:21:23.406 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:359: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-21T12:21:23.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:360: TEST_bluestore2: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-21T12:21:23.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:362: TEST_bluestore2: run_mon td/osd-bluefs-volume-ops a 2026-02-21T12:21:23.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:21:23.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-21T12:21:23.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-21T12:21:23.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-21T12:21:23.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-21T12:21:23.407 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-21T12:21:23.426 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-21T12:21:23.426 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:21:23.426 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:21:23.426 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:21:23.427 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:21:23.427 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:21:23.427 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:21:23.427 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-21T12:21:23.451 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-21T12:21:23.453 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-21T12:21:23.453 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:21:23.453 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:21:23.453 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-21T12:21:23.453 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-21T12:21:23.453 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:21:23.453 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:21:23.454 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:21:23.454 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:21:23.454 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:21:23.454 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:21:23.454 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108826/ceph-mon.a.asok 2026-02-21T12:21:23.454 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:21:23.454 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108826/ceph-mon.a.asok config get fsid 2026-02-21T12:21:23.498 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-21T12:21:23.499 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:21:23.499 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:21:23.499 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-21T12:21:23.499 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-21T12:21:23.499 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:21:23.499 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:21:23.500 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:21:23.500 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:21:23.500 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:21:23.500 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:21:23.500 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108826/ceph-mon.a.asok 2026-02-21T12:21:23.501 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:21:23.501 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108826/ceph-mon.a.asok config get mon_host 2026-02-21T12:21:23.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:363: TEST_bluestore2: run_mgr td/osd-bluefs-volume-ops x 2026-02-21T12:21:23.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:21:23.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-21T12:21:23.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-21T12:21:23.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-21T12:21:23.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-21T12:21:23.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-21T12:21:23.642 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-21T12:21:23.642 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:21:23.642 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:21:23.642 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:21:23.642 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:21:23.642 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:21:23.643 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:21:23.643 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:21:23.643 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:21:23.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:364: TEST_bluestore2: run_osd td/osd-bluefs-volume-ops 0 2026-02-21T12:21:23.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:21:23.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:21:23.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-21T12:21:23.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:21:23.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-21T12:21:23.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=03ed540f-f989-453b-9fa1-82051fd54a1c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-21T12:21:23.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:21:23.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:21:23.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:21:23.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-21T12:21:23.662 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=affb374c-06a4-4b5b-af93-8c47f0970404 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 affb374c-06a4-4b5b-af93-8c47f0970404' 2026-02-21T12:21:23.663 INFO:tasks.workunit.client.0.trial058.stdout:add osd0 affb374c-06a4-4b5b-af93-8c47f0970404 2026-02-21T12:21:23.664 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:21:23.675 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBDo5lpFerWKBAA1Gvoy1EPO5fhIRnO9Ws1ow== 2026-02-21T12:21:23.675 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBDo5lpFerWKBAA1Gvoy1EPO5fhIRnO9Ws1ow=="}' 2026-02-21T12:21:23.675 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new affb374c-06a4-4b5b-af93-8c47f0970404 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-21T12:21:23.779 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:21:23.785 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-21T12:21:23.786 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=03ed540f-f989-453b-9fa1-82051fd54a1c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBDo5lpFerWKBAA1Gvoy1EPO5fhIRnO9Ws1ow== --osd-uuid affb374c-06a4-4b5b-af93-8c47f0970404 2026-02-21T12:21:23.804 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:23.814+0000 7fea09214780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:21:23.806 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:23.816+0000 7fea09214780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:21:23.807 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:23.817+0000 7fea09214780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:21:23.807 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:23.817+0000 7fea09214780 -1 bdev(0x427a000 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-21T12:21:23.807 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:23.817+0000 7fea09214780 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-21T12:21:24.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-21T12:21:24.561 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:21:24.562 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-21T12:21:24.562 INFO:tasks.workunit.client.0.trial058.stdout:adding osd0 key to auth repository 2026-02-21T12:21:24.562 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:21:24.667 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:21:24.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-21T12:21:24.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=03ed540f-f989-453b-9fa1-82051fd54a1c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:21:24.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:21:24.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:21:24.669 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:21:24.685 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:24.695+0000 7f18c61fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:21:24.686 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:24.696+0000 7f18c61fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:21:24.687 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:24.697+0000 7f18c61fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:21:24.768 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-21T12:21:24.768 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:21:24.768 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:21:24.768 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:21:24.768 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:21:24.768 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:21:24.769 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:21:24.770 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:21:24.770 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:21:24.770 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:21:24.866 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:21:24.940 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:24.949+0000 7f18c61fd780 -1 Falling back to public interface 2026-02-21T12:21:25.522 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:25.532+0000 7f18c61fd780 -1 osd.0 0 log_to_monitors true 2026-02-21T12:21:25.867 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:21:25.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:21:25.868 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:21:25.868 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:21:25.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:21:25.869 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:21:26.097 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2676686081,v1:127.0.0.1:6801/2676686081] [v2:127.0.0.1:6802/2676686081,v1:127.0.0.1:6803/2676686081] exists,up affb374c-06a4-4b5b-af93-8c47f0970404 2026-02-21T12:21:26.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:21:26.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:21:26.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:21:26.099 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-21T12:21:26.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: osd_pid0=154989 2026-02-21T12:21:26.099 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:367: TEST_bluestore2: sleep 5 2026-02-21T12:21:31.100 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:368: TEST_bluestore2: create_pool foo 16 2026-02-21T12:21:31.100 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-21T12:21:31.380 INFO:tasks.workunit.client.0.trial058.stderr:pool 'foo' already exists 2026-02-21T12:21:31.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-21T12:21:32.390 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:370: TEST_bluestore2: retry = 0 2026-02-21T12:21:32.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 370: retry: command not found 2026-02-21T12:21:32.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:371: TEST_bluestore2: [[ '' -le 5 ]] 2026-02-21T12:21:32.391 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:373: TEST_bluestore2: timeout 60 rados bench -p foo 10 write --write-omap --no-cleanup 2026-02-21T12:21:32.411 INFO:tasks.workunit.client.0.trial058.stdout:hints = 1 2026-02-21T12:21:32.412 INFO:tasks.workunit.client.0.trial058.stdout:Maintaining 16 concurrent writes of 4194304 bytes to objects of size 4194304 for up to 10 seconds or 0 objects 2026-02-21T12:21:32.412 INFO:tasks.workunit.client.0.trial058.stdout:Object prefix: benchmark_data_trial058_156338 2026-02-21T12:21:32.433 INFO:tasks.workunit.client.0.trial058.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-21T12:21:32.433 INFO:tasks.workunit.client.0.trial058.stdout: 0 0 0 0 0 0 - 0 2026-02-21T12:21:33.433 INFO:tasks.workunit.client.0.trial058.stdout: 1 16 183 167 667.953 668 0.082006 0.0895565 2026-02-21T12:21:34.433 INFO:tasks.workunit.client.0.trial058.stdout: 2 16 391 375 749.948 832 0.0738695 0.0836186 2026-02-21T12:21:35.433 INFO:tasks.workunit.client.0.trial058.stdout: 3 16 583 567 755.949 768 0.0682816 0.083469 2026-02-21T12:21:36.433 INFO:tasks.workunit.client.0.trial058.stdout: 4 16 775 759 758.948 768 0.0833451 0.0838631 2026-02-21T12:21:37.433 INFO:tasks.workunit.client.0.trial058.stdout: 5 16 983 967 773.546 832 0.0848153 0.0819686 2026-02-21T12:21:38.433 INFO:tasks.workunit.client.0.trial058.stdout: 6 16 1175 1159 772.613 768 0.0726298 0.0821862 2026-02-21T12:21:39.433 INFO:tasks.workunit.client.0.trial058.stdout: 7 16 1351 1335 762.803 704 0.0678892 0.0832556 2026-02-21T12:21:40.433 INFO:tasks.workunit.client.0.trial058.stdout: 8 16 1553 1537 768.445 808 0.0842308 0.0828187 2026-02-21T12:21:41.433 INFO:tasks.workunit.client.0.trial058.stdout: 9 16 1761 1745 775.5 832 0.0893613 0.0821618 2026-02-21T12:21:42.433 INFO:tasks.workunit.client.0.trial058.stdout: 10 16 1943 1927 770.745 728 0.0803454 0.082571 2026-02-21T12:21:43.434 INFO:tasks.workunit.client.0.trial058.stdout:Total time run: 10.0378 2026-02-21T12:21:43.434 INFO:tasks.workunit.client.0.trial058.stdout:Total writes made: 1943 2026-02-21T12:21:43.434 INFO:tasks.workunit.client.0.trial058.stdout:Write size: 4194304 2026-02-21T12:21:43.434 INFO:tasks.workunit.client.0.trial058.stdout:Object size: 4194304 2026-02-21T12:21:43.434 INFO:tasks.workunit.client.0.trial058.stdout:Bandwidth (MB/sec): 774.274 2026-02-21T12:21:43.434 INFO:tasks.workunit.client.0.trial058.stdout:Stddev Bandwidth: 57.2573 2026-02-21T12:21:43.435 INFO:tasks.workunit.client.0.trial058.stdout:Max bandwidth (MB/sec): 832 2026-02-21T12:21:43.435 INFO:tasks.workunit.client.0.trial058.stdout:Min bandwidth (MB/sec): 668 2026-02-21T12:21:43.435 INFO:tasks.workunit.client.0.trial058.stdout:Average IOPS: 193 2026-02-21T12:21:43.435 INFO:tasks.workunit.client.0.trial058.stdout:Stddev IOPS: 14.3143 2026-02-21T12:21:43.435 INFO:tasks.workunit.client.0.trial058.stdout:Max IOPS: 208 2026-02-21T12:21:43.435 INFO:tasks.workunit.client.0.trial058.stdout:Min IOPS: 167 2026-02-21T12:21:43.435 INFO:tasks.workunit.client.0.trial058.stdout:Average Latency(s): 0.082524 2026-02-21T12:21:43.435 INFO:tasks.workunit.client.0.trial058.stdout:Stddev Latency(s): 0.0104466 2026-02-21T12:21:43.435 INFO:tasks.workunit.client.0.trial058.stdout:Max latency(s): 0.119417 2026-02-21T12:21:43.435 INFO:tasks.workunit.client.0.trial058.stdout:Min latency(s): 0.0246762 2026-02-21T12:21:43.443 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:376: TEST_bluestore2: sleep 10 2026-02-21T12:21:53.446 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-21T12:21:53.446 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: jq .bluefs.db_used_bytes 2026-02-21T12:21:53.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: db_used=1013972992 2026-02-21T12:21:53.517 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-21T12:21:53.517 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: jq .bluefs.slow_used_bytes 2026-02-21T12:21:53.588 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: spilled_over=69402624 2026-02-21T12:21:53.588 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:380: TEST_bluestore2: (( retry+=1 )) 2026-02-21T12:21:53.588 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: test 69402624 -eq 0 2026-02-21T12:21:53.588 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: break 2026-02-21T12:21:53.589 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:383: TEST_bluestore2: test 69402624 -gt 0 2026-02-21T12:21:53.589 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 154989 2026-02-21T12:21:53.589 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: sleep 1 2026-02-21T12:21:54.588 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 154989 2026-02-21T12:21:54.589 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 385: kill: (154989) - No such process 2026-02-21T12:21:54.589 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:386: TEST_bluestore2: ceph osd down 0 2026-02-21T12:21:54.820 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already down. 2026-02-21T12:21:54.827 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:388: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/block --command bluefs-bdev-migrate 2026-02-21T12:21:54.839 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:21:56.654 INFO:tasks.workunit.client.0.trial058.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-21T12:21:56.675 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:393: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command bluefs-bdev-sizes 2026-02-21T12:21:56.687 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:21:57.193 INFO:tasks.workunit.client.0.trial058.stdout:1 : device size 0x100000000(4 GiB) : using 0x40448000(1.0 GiB) : bluefs used 0x40430000(1.0 GiB) : non-bluefs used 0x18000(96 KiB) 2026-02-21T12:21:57.235 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:396: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command fsck 2026-02-21T12:21:58.848 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:21:58.922 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:399: TEST_bluestore2: activate_osd td/osd-bluefs-volume-ops 0 2026-02-21T12:21:58.922 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:21:58.923 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:21:58.923 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-21T12:21:58.923 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:21:58.923 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-21T12:21:58.923 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=03ed540f-f989-453b-9fa1-82051fd54a1c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-21T12:21:58.923 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:21:58.923 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:21:58.923 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:21:58.923 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-21T12:21:58.923 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-21T12:21:58.924 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:21:58.924 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:21:58.924 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:21:58.924 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:21:58.924 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:21:58.924 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:21:58.924 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:21:58.924 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:21:58.924 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:21:58.924 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:21:58.924 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:21:58.924 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:21:58.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:21:58.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:21:58.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:21:58.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:21:58.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:21:58.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:21:58.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:21:58.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:21:58.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-21T12:21:58.925 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-21T12:21:58.926 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:21:58.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=03ed540f-f989-453b-9fa1-82051fd54a1c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:21:58.927 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-21T12:21:58.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-21T12:21:58.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:21:58.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:21:58.927 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:21:58.938 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:58.947+0000 7fe47e845780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:21:58.939 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:58.948+0000 7fe47e845780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:21:58.940 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:58.949+0000 7fe47e845780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:21:59.079 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:21:59.088+0000 7fe47e845780 -1 Falling back to public interface 2026-02-21T12:21:59.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-21T12:21:59.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:21:59.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:21:59.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:21:59.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:21:59.156 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:21:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:21:59.157 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:21:59.157 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:21:59.158 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:21:59.385 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:22:00.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:22:00.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:22:00.387 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:22:00.387 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:22:00.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:22:00.388 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:22:00.640 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:22:01.495 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:22:01.505+0000 7fe47e845780 -1 osd.0 9 log_to_monitors true 2026-02-21T12:22:01.641 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:22:01.641 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:22:01.642 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:22:01.642 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:22:01.642 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:22:01.643 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:22:01.902 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:22:02.903 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:22:02.903 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:22:02.903 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-21T12:22:02.904 INFO:tasks.workunit.client.0.trial058.stdout:3 2026-02-21T12:22:02.904 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:22:02.904 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:22:03.133 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 12 up_thru 12 down_at 9 last_clean_interval [5,9) [v2:127.0.0.1:6800/3876632846,v1:127.0.0.1:6801/3876632846] [v2:127.0.0.1:6802/3876632846,v1:127.0.0.1:6803/3876632846] exists,up affb374c-06a4-4b5b-af93-8c47f0970404 2026-02-21T12:22:03.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:22:03.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:22:03.134 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:22:03.134 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-21T12:22:03.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: osd_pid0=157582 2026-02-21T12:22:03.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:402: TEST_bluestore2: wait_for_clean 2026-02-21T12:22:03.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:22:03.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:22:03.135 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:22:03.135 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-21T12:22:03.136 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:22:03.136 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:22:03.136 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:22:03.137 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:22:03.137 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:22:03.219 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-21T12:22:03.219 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:22:03.220 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:22:03.220 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:22:03.220 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:22:03.220 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:22:03.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids=0 2026-02-21T12:22:03.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:22:03.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:22:03.447 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:22:03.514 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=51539607555 2026-02-21T12:22:03.514 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 51539607555 2026-02-21T12:22:03.514 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-51539607555' 2026-02-21T12:22:03.514 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:22:03.514 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-51539607555 2026-02-21T12:22:03.515 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:22:03.515 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:22:03.515 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-51539607555 2026-02-21T12:22:03.516 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:22:03.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=51539607555 2026-02-21T12:22:03.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 51539607555' 2026-02-21T12:22:03.517 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 51539607555 2026-02-21T12:22:03.517 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:22:03.750 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 51539607555 -lt 51539607555 2026-02-21T12:22:03.750 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:22:03.751 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:22:03.751 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:22:04.070 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-21T12:22:04.070 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:22:04.070 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:22:04.070 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:22:04.070 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:22:04.070 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:22:04.071 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:22:04.071 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:22:04.298 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-21T12:22:04.298 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:22:04.298 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:22:04.298 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:22:04.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-21T12:22:04.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:22:04.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:22:04.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-21T12:22:04.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:22:04.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:22:04.613 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-21T12:22:04.614 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:22:04.614 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:22:04.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:22:04.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:22:04.614 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:22:04.721 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:22:04.722 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:22:04.723 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:22:04.723 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:22:04.724 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:22:04.724 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:22:04.725 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:22:04.726 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:22:04.726 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:22:04.726 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:22:04.727 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:22:04.728 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:22:04.729 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:22:04.729 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-21T12:22:05.044 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:22:05.044 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:22:05.044 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:22:05.045 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108826 2026-02-21T12:22:05.047 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:22:05.047 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:22:05.047 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-21T12:22:05.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-21T12:22:05.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:22:05.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-21T12:22:05.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:22:05.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-21T12:22:05.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-21T12:22:05.048 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:22:05.048 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:22:05.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:22:05.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:22:05.048 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:22:05.049 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:22:05.049 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:22:05.049 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:22:05.050 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:22:05.051 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:22:05.051 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:22:05.051 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:22:05.052 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:22:05.052 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:22:05.052 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:22:05.052 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:22:05.053 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:22:05.054 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-21T12:22:05.054 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-21T12:22:05.055 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:22:05.056 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:22:05.056 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:22:05.056 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108826 2026-02-21T12:22:05.056 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:22:05.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:22:05.057 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-21T12:22:05.058 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-21T12:22:05.058 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:22:05.058 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:22:05.058 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.108826 2026-02-21T12:22:05.059 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-21T12:22:05.060 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-21T12:22:05.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-21T12:22:05.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-21T12:22:05.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore_expand td/osd-bluefs-volume-ops 2026-02-21T12:22:05.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:406: TEST_bluestore_expand: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:22:05.061 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: ulimit -n 2026-02-21T12:22:05.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: local flimit=4096 2026-02-21T12:22:05.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:409: TEST_bluestore_expand: '[' 4096 -lt 1536 ']' 2026-02-21T12:22:05.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: export CEPH_MON=127.0.0.1:7146 2026-02-21T12:22:05.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: CEPH_MON=127.0.0.1:7146 2026-02-21T12:22:05.061 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:413: TEST_bluestore_expand: export CEPH_ARGS 2026-02-21T12:22:05.061 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: uuidgen 2026-02-21T12:22:05.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: CEPH_ARGS+='--fsid=cf3cdc3d-7713-41bf-87bf-cebde0e3d4ba --auth-supported=none ' 2026-02-21T12:22:05.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:415: TEST_bluestore_expand: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-21T12:22:05.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:416: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-21T12:22:05.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:417: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-21T12:22:05.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:418: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-21T12:22:05.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:419: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-21T12:22:05.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:420: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-21T12:22:05.064 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:421: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-21T12:22:05.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:422: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-21T12:22:05.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:423: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-21T12:22:05.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:425: TEST_bluestore_expand: run_mon td/osd-bluefs-volume-ops a 2026-02-21T12:22:05.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:22:05.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-21T12:22:05.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-21T12:22:05.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-21T12:22:05.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-21T12:22:05.065 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-21T12:22:05.085 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-21T12:22:05.086 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:22:05.086 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:22:05.086 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:22:05.086 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:22:05.086 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:22:05.086 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:22:05.086 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-21T12:22:05.112 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-21T12:22:05.114 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-21T12:22:05.114 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:22:05.114 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:22:05.114 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-21T12:22:05.114 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-21T12:22:05.114 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:22:05.114 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:22:05.114 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:22:05.115 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:22:05.115 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:22:05.115 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:22:05.116 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108826/ceph-mon.a.asok 2026-02-21T12:22:05.116 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:22:05.116 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108826/ceph-mon.a.asok config get fsid 2026-02-21T12:22:05.158 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-21T12:22:05.159 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-21T12:22:05.159 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-21T12:22:05.159 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-21T12:22:05.159 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-21T12:22:05.159 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-21T12:22:05.159 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-21T12:22:05.159 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-21T12:22:05.160 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-21T12:22:05.160 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:22:05.160 INFO:tasks.workunit.client.0.trial058.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:22:05.160 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108826/ceph-mon.a.asok 2026-02-21T12:22:05.161 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-21T12:22:05.161 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108826/ceph-mon.a.asok config get mon_host 2026-02-21T12:22:05.200 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:426: TEST_bluestore_expand: run_mgr td/osd-bluefs-volume-ops x 2026-02-21T12:22:05.200 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:22:05.200 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-21T12:22:05.200 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-21T12:22:05.201 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-21T12:22:05.201 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-21T12:22:05.201 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-21T12:22:05.306 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-21T12:22:05.306 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:22:05.306 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:22:05.306 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:22:05.306 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:22:05.306 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:22:05.306 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:22:05.307 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:22:05.307 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-21T12:22:05.329 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:427: TEST_bluestore_expand: run_osd td/osd-bluefs-volume-ops 0 2026-02-21T12:22:05.329 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:22:05.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-21T12:22:05.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-21T12:22:05.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-21T12:22:05.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-21T12:22:05.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=03ed540f-f989-453b-9fa1-82051fd54a1c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=cf3cdc3d-7713-41bf-87bf-cebde0e3d4ba --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-21T12:22:05.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:22:05.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:22:05.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:22:05.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-21T12:22:05.330 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-21T12:22:05.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-21T12:22:05.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-21T12:22:05.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:22:05.331 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-21T12:22:05.331 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:22:05.331 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:22:05.331 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:22:05.331 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:22:05.331 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:22:05.331 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:22:05.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:22:05.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-21T12:22:05.332 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=aae063b8-8762-41fe-a6eb-6a906bf53c08 2026-02-21T12:22:05.333 INFO:tasks.workunit.client.0.trial058.stdout:add osd0 aae063b8-8762-41fe-a6eb-6a906bf53c08 2026-02-21T12:22:05.333 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 aae063b8-8762-41fe-a6eb-6a906bf53c08' 2026-02-21T12:22:05.333 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-21T12:22:05.343 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBto5lpLYQGFRAAd0G+KeZvQt3aumJprmAE0A== 2026-02-21T12:22:05.343 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBto5lpLYQGFRAAd0G+KeZvQt3aumJprmAE0A=="}' 2026-02-21T12:22:05.343 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new aae063b8-8762-41fe-a6eb-6a906bf53c08 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-21T12:22:05.450 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:22:05.456 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-21T12:22:05.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=03ed540f-f989-453b-9fa1-82051fd54a1c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=cf3cdc3d-7713-41bf-87bf-cebde0e3d4ba --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBto5lpLYQGFRAAd0G+KeZvQt3aumJprmAE0A== --osd-uuid aae063b8-8762-41fe-a6eb-6a906bf53c08 2026-02-21T12:22:05.478 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:22:05.488+0000 7f6ebc62c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:22:05.480 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:22:05.489+0000 7f6ebc62c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:22:05.480 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:22:05.490+0000 7f6ebc62c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:22:05.481 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:22:05.490+0000 7f6ebc62c780 -1 bdev(0x3956000 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-21T12:22:05.481 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:22:05.490+0000 7f6ebc62c780 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-21T12:22:06.222 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-21T12:22:06.222 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-21T12:22:06.223 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-21T12:22:06.223 INFO:tasks.workunit.client.0.trial058.stdout:adding osd0 key to auth repository 2026-02-21T12:22:06.223 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-21T12:22:06.333 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-21T12:22:06.333 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:22:06.334 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-21T12:22:06.334 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=03ed540f-f989-453b-9fa1-82051fd54a1c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=cf3cdc3d-7713-41bf-87bf-cebde0e3d4ba --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:22:06.334 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-21T12:22:06.334 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-21T12:22:06.354 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:22:06.363+0000 7f6cdfa6f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:22:06.355 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:22:06.365+0000 7f6cdfa6f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:22:06.356 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:22:06.366+0000 7f6cdfa6f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:22:06.439 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-21T12:22:06.439 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:22:06.439 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:22:06.439 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:22:06.439 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:22:06.440 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:22:06.440 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:22:06.440 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:22:06.440 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:22:06.441 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:22:06.540 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:22:06.592 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:22:06.601+0000 7f6cdfa6f780 -1 Falling back to public interface 2026-02-21T12:22:07.278 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:22:07.288+0000 7f6cdfa6f780 -1 osd.0 0 log_to_monitors true 2026-02-21T12:22:07.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:22:07.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:22:07.541 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:22:07.542 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:22:07.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:22:07.542 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:22:07.776 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:22:08.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:22:08.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:22:08.778 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:22:08.778 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:22:08.779 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:22:08.779 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:22:09.008 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/432671250,v1:127.0.0.1:6801/432671250] [v2:127.0.0.1:6802/432671250,v1:127.0.0.1:6803/432671250] exists,up aae063b8-8762-41fe-a6eb-6a906bf53c08 2026-02-21T12:22:09.008 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:22:09.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:22:09.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:22:09.009 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-21T12:22:09.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: osd_pid0=160116 2026-02-21T12:22:09.009 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:430: TEST_bluestore_expand: sleep 5 2026-02-21T12:22:14.010 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:431: TEST_bluestore_expand: create_pool foo 16 2026-02-21T12:22:14.011 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-21T12:22:14.293 INFO:tasks.workunit.client.0.trial058.stderr:pool 'foo' already exists 2026-02-21T12:22:14.301 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-21T12:22:15.302 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:434: TEST_bluestore_expand: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-21T12:22:15.326 INFO:tasks.workunit.client.0.trial058.stdout:hints = 1 2026-02-21T12:22:15.326 INFO:tasks.workunit.client.0.trial058.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-21T12:22:15.326 INFO:tasks.workunit.client.0.trial058.stdout:Object prefix: benchmark_data_trial058_161222 2026-02-21T12:22:15.327 INFO:tasks.workunit.client.0.trial058.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-21T12:22:15.327 INFO:tasks.workunit.client.0.trial058.stdout: 0 0 0 0 0 0 - 0 2026-02-21T12:22:16.326 INFO:tasks.workunit.client.0.trial058.stdout: 1 16 18948 18932 73.9475 73.9531 0.00126593 0.000844097 2026-02-21T12:22:17.326 INFO:tasks.workunit.client.0.trial058.stdout: 2 16 37736 37720 73.6662 73.3906 0.000688975 0.000847589 2026-02-21T12:22:18.326 INFO:tasks.workunit.client.0.trial058.stdout: 3 16 56152 56136 73.0883 71.9375 0.00110993 0.000854329 2026-02-21T12:22:19.326 INFO:tasks.workunit.client.0.trial058.stdout: 4 16 74862 74846 73.0864 73.0859 0.000835589 0.000854372 2026-02-21T12:22:20.326 INFO:tasks.workunit.client.0.trial058.stdout: 5 16 93131 93115 72.7407 71.3633 0.00103193 0.000858445 2026-02-21T12:22:21.326 INFO:tasks.workunit.client.0.trial058.stdout: 6 16 110780 110764 72.1067 68.9414 0.000709305 0.000866007 2026-02-21T12:22:22.327 INFO:tasks.workunit.client.0.trial058.stdout: 7 16 128220 128204 71.5372 68.125 0.00115999 0.0008729 2026-02-21T12:22:23.327 INFO:tasks.workunit.client.0.trial058.stdout: 8 16 145470 145454 71.0173 67.3828 0.000857642 0.000879308 2026-02-21T12:22:24.327 INFO:tasks.workunit.client.0.trial058.stdout: 9 15 162581 162566 70.553 66.8438 0.00206235 0.000885078 2026-02-21T12:22:25.327 INFO:tasks.workunit.client.0.trial058.stdout: 10 16 179046 179030 69.9285 64.3125 0.000879233 0.000893012 2026-02-21T12:22:26.327 INFO:tasks.workunit.client.0.trial058.stdout: 11 16 195107 195091 69.2744 62.7383 0.000898729 0.000901471 2026-02-21T12:22:27.327 INFO:tasks.workunit.client.0.trial058.stdout: 12 16 211369 211353 68.7947 63.5234 0.000548385 0.000907748 2026-02-21T12:22:28.327 INFO:tasks.workunit.client.0.trial058.stdout: 13 16 227472 227456 68.3411 62.9023 0.00119107 0.000913773 2026-02-21T12:22:29.327 INFO:tasks.workunit.client.0.trial058.stdout: 14 16 243576 243560 67.9526 62.9062 0.00097402 0.000918998 2026-02-21T12:22:30.327 INFO:tasks.workunit.client.0.trial058.stdout: 15 16 259491 259475 67.5666 62.168 0.00088307 0.000924259 2026-02-21T12:22:31.327 INFO:tasks.workunit.client.0.trial058.stdout: 16 16 275348 275332 67.2148 61.9414 0.000707792 0.000929093 2026-02-21T12:22:32.327 INFO:tasks.workunit.client.0.trial058.stdout: 17 16 291530 291514 66.979 63.2109 0.000936731 0.00093238 2026-02-21T12:22:33.328 INFO:tasks.workunit.client.0.trial058.stdout: 18 16 307740 307724 66.7754 63.3203 0.00150761 0.000935213 2026-02-21T12:22:34.328 INFO:tasks.workunit.client.0.trial058.stdout: 19 16 323793 323777 66.561 62.707 0.000508871 0.000938215 2026-02-21T12:22:35.328 INFO:tasks.workunit.client.0.trial058.stdout:2026-02-21T12:22:35.337886+0000 min lat: 0.000288749 max lat: 0.00519823 avg lat: 0.000940733 2026-02-21T12:22:35.328 INFO:tasks.workunit.client.0.trial058.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-21T12:22:35.328 INFO:tasks.workunit.client.0.trial058.stdout: 20 16 339926 339910 66.3837 63.0195 0.000783524 0.000940733 2026-02-21T12:22:36.328 INFO:tasks.workunit.client.0.trial058.stdout: 21 16 354206 354190 65.8786 55.7812 0.0985844 0.000946762 2026-02-21T12:22:37.328 INFO:tasks.workunit.client.0.trial058.stdout: 22 16 354382 354366 62.9154 0.6875 0.101712 0.000990719 2026-02-21T12:22:38.328 INFO:tasks.workunit.client.0.trial058.stdout: 23 16 354863 354847 60.2617 1.87891 0.0230305 0.00103598 2026-02-21T12:22:39.328 INFO:tasks.workunit.client.0.trial058.stdout: 24 16 355215 355199 57.8081 1.375 0.0322466 0.00107934 2026-02-21T12:22:40.328 INFO:tasks.workunit.client.0.trial058.stdout: 25 16 355563 355547 55.5501 1.35938 0.13039 0.00112238 2026-02-21T12:22:41.328 INFO:tasks.workunit.client.0.trial058.stdout: 26 16 355675 355659 53.4304 0.4375 0.148125 0.00116612 2026-02-21T12:22:42.328 INFO:tasks.workunit.client.0.trial058.stdout: 27 16 363438 363422 52.5746 30.3242 0.00055131 0.00118801 2026-02-21T12:22:43.328 INFO:tasks.workunit.client.0.trial058.stdout: 28 16 379890 379874 52.992 64.2656 0.000750312 0.00117866 2026-02-21T12:22:44.328 INFO:tasks.workunit.client.0.trial058.stdout: 29 16 396091 396075 53.3467 63.2852 0.00117662 0.00117082 2026-02-21T12:22:45.329 INFO:tasks.workunit.client.0.trial058.stdout:Total time run: 30.001 2026-02-21T12:22:45.329 INFO:tasks.workunit.client.0.trial058.stdout:Total writes made: 412285 2026-02-21T12:22:45.329 INFO:tasks.workunit.client.0.trial058.stdout:Write size: 4096 2026-02-21T12:22:45.329 INFO:tasks.workunit.client.0.trial058.stdout:Object size: 4096 2026-02-21T12:22:45.329 INFO:tasks.workunit.client.0.trial058.stdout:Bandwidth (MB/sec): 53.6811 2026-02-21T12:22:45.329 INFO:tasks.workunit.client.0.trial058.stdout:Stddev Bandwidth: 25.4463 2026-02-21T12:22:45.329 INFO:tasks.workunit.client.0.trial058.stdout:Max bandwidth (MB/sec): 73.9531 2026-02-21T12:22:45.330 INFO:tasks.workunit.client.0.trial058.stdout:Min bandwidth (MB/sec): 0.4375 2026-02-21T12:22:45.330 INFO:tasks.workunit.client.0.trial058.stdout:Average IOPS: 13742 2026-02-21T12:22:45.330 INFO:tasks.workunit.client.0.trial058.stdout:Stddev IOPS: 6514.25 2026-02-21T12:22:45.330 INFO:tasks.workunit.client.0.trial058.stdout:Max IOPS: 18932 2026-02-21T12:22:45.330 INFO:tasks.workunit.client.0.trial058.stdout:Min IOPS: 112 2026-02-21T12:22:45.330 INFO:tasks.workunit.client.0.trial058.stdout:Average Latency(s): 0.00116353 2026-02-21T12:22:45.330 INFO:tasks.workunit.client.0.trial058.stdout:Stddev Latency(s): 0.0043017 2026-02-21T12:22:45.330 INFO:tasks.workunit.client.0.trial058.stdout:Max latency(s): 0.165192 2026-02-21T12:22:45.330 INFO:tasks.workunit.client.0.trial058.stdout:Min latency(s): 0.000288749 2026-02-21T12:22:45.331 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:435: TEST_bluestore_expand: sleep 5 2026-02-21T12:22:50.333 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-21T12:22:50.333 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-21T12:22:50.409 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: total_space_before=4294967296 2026-02-21T12:22:50.410 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-21T12:22:50.410 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-21T12:22:50.410 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep free 2026-02-21T12:22:50.410 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d: -f 2 2026-02-21T12:22:50.410 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d, -f 1 2026-02-21T12:22:50.410 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-21T12:22:50.477 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: free_space_before=2606149632 2026-02-21T12:22:50.477 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 160116 2026-02-21T12:22:50.477 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: sleep 1 2026-02-21T12:22:51.478 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 160116 2026-02-21T12:22:51.479 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 441: kill: (160116) - No such process 2026-02-21T12:22:51.479 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:442: TEST_bluestore_expand: ceph osd down 0 2026-02-21T12:22:51.712 INFO:tasks.workunit.client.0.trial058.stderr:osd.0 is already down. 2026-02-21T12:22:51.719 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:445: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 allocmap 2026-02-21T12:22:51.735 INFO:tasks.workunit.client.0.trial058.stdout:allocmap bluestore.allocmap 2026-02-21T12:23:32.642 INFO:tasks.workunit.client.0.trial058.stdout:allocmap success 2026-02-21T12:23:32.670 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:448: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-21T12:24:14.854 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:24:14.881 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:450: TEST_bluestore_expand: requested_space=4294967296 2026-02-21T12:24:14.881 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:451: TEST_bluestore_expand: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-21T12:24:14.882 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:452: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-21T12:24:14.897 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:24:55.002 INFO:tasks.workunit.client.0.trial058.stdout:1 : device size 0x40000000(1 GiB) : using 0x2f700000(759 MiB) 2026-02-21T12:24:55.002 INFO:tasks.workunit.client.0.trial058.stdout:2 : device size 0x100000000(4 GiB) : using 0x64a97000(1.6 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0x64a97000(1.6 GiB) 2026-02-21T12:24:55.002 INFO:tasks.workunit.client.0.trial058.stdout:Expanding DB/WAL... 2026-02-21T12:24:55.002 INFO:tasks.workunit.client.0.trial058.stdout:1 : nothing to do, skipped 2026-02-21T12:24:55.003 INFO:tasks.workunit.client.0.trial058.stdout:2 : nothing to do, skipped 2026-02-21T12:24:55.080 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:455: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-21T12:25:36.791 INFO:tasks.workunit.client.0.trial058.stdout:fsck success 2026-02-21T12:25:36.820 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:458: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 qfsck 2026-02-21T12:25:36.835 INFO:tasks.workunit.client.0.trial058.stdout:qfsck bluestore.quick-fsck 2026-02-21T12:26:17.655 INFO:tasks.workunit.client.0.trial058.stdout:qfsck success 2026-02-21T12:26:17.680 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:460: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-21T12:26:17.696 INFO:tasks.workunit.client.0.trial058.stdout:inferring bluefs devices from bluestore path 2026-02-21T12:26:56.956 INFO:tasks.workunit.client.0.trial058.stdout:1 : device size 0x40000000(1 GiB) : using 0x2f700000(759 MiB) 2026-02-21T12:26:56.957 INFO:tasks.workunit.client.0.trial058.stdout:2 : device size 0x100000000(4 GiB) : using 0x64a97000(1.6 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0x64a97000(1.6 GiB) 2026-02-21T12:26:57.031 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:462: TEST_bluestore_expand: activate_osd td/osd-bluefs-volume-ops 0 2026-02-21T12:26:57.031 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:26:57.031 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-21T12:26:57.031 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=03ed540f-f989-453b-9fa1-82051fd54a1c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=cf3cdc3d-7713-41bf-87bf-cebde0e3d4ba --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-21T12:26:57.032 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-21T12:26:57.033 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-21T12:26:57.034 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-21T12:26:57.034 INFO:tasks.workunit.client.0.trial058.stdout:start osd.0 2026-02-21T12:26:57.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=8850d4c6-3303-40e7-b1f1-b1bb36227cc9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=03ed540f-f989-453b-9fa1-82051fd54a1c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=cf3cdc3d-7713-41bf-87bf-cebde0e3d4ba --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.108826/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-21T12:26:57.035 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-21T12:26:57.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-21T12:26:57.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-21T12:26:57.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-21T12:26:57.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-21T12:26:57.052 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:26:57.060+0000 7f1e6425c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:26:57.054 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:26:57.062+0000 7f1e6425c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:26:57.055 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:26:57.063+0000 7f1e6425c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-21T12:26:57.188 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:26:57.196+0000 7f1e6425c780 -1 Falling back to public interface 2026-02-21T12:26:57.269 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-21T12:26:57.269 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-21T12:26:57.269 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-21T12:26:57.269 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-21T12:26:57.269 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-21T12:26:57.269 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:26:57.270 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-21T12:26:57.270 INFO:tasks.workunit.client.0.trial058.stdout:0 2026-02-21T12:26:57.270 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:26:57.270 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:26:57.503 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:26:58.504 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:26:58.504 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:26:58.505 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-21T12:26:58.505 INFO:tasks.workunit.client.0.trial058.stdout:1 2026-02-21T12:26:58.505 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:26:58.506 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:26:58.740 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:26:59.741 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:26:59.742 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:26:59.742 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-21T12:26:59.742 INFO:tasks.workunit.client.0.trial058.stdout:2 2026-02-21T12:26:59.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:26:59.743 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:26:59.983 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:27:00.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:27:00.984 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:27:00.985 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-21T12:27:00.985 INFO:tasks.workunit.client.0.trial058.stdout:3 2026-02-21T12:27:00.985 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:27:00.986 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:27:01.221 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:27:02.222 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:27:02.223 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:27:02.223 INFO:tasks.workunit.client.0.trial058.stdout:4 2026-02-21T12:27:02.224 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-21T12:27:02.224 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:27:02.224 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:27:02.455 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:27:03.456 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:27:03.456 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:27:03.456 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-21T12:27:03.457 INFO:tasks.workunit.client.0.trial058.stdout:5 2026-02-21T12:27:03.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:27:03.457 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:27:03.691 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:27:04.692 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:27:04.693 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:27:04.693 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-21T12:27:04.693 INFO:tasks.workunit.client.0.trial058.stdout:6 2026-02-21T12:27:04.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:27:04.694 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:27:04.928 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:27:05.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:27:05.930 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:27:05.930 INFO:tasks.workunit.client.0.trial058.stdout:7 2026-02-21T12:27:05.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-21T12:27:05.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:27:05.931 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:27:05.989 INFO:tasks.workunit.client.0.trial058.stderr:2026-02-21T12:27:05.996+0000 7f1e6425c780 -1 osd.0 10 log_to_monitors true 2026-02-21T12:27:06.177 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-21T12:27:07.178 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-21T12:27:07.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-21T12:27:07.179 INFO:tasks.workunit.client.0.trial058.stdout:8 2026-02-21T12:27:07.179 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-21T12:27:07.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-21T12:27:07.180 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-21T12:27:07.412 INFO:tasks.workunit.client.0.trial058.stdout:osd.0 up in weight 1 up_from 13 up_thru 13 down_at 10 last_clean_interval [5,10) [v2:127.0.0.1:6800/2556862819,v1:127.0.0.1:6801/2556862819] [v2:127.0.0.1:6802/2556862819,v1:127.0.0.1:6803/2556862819] exists,up aae063b8-8762-41fe-a6eb-6a906bf53c08 2026-02-21T12:27:07.412 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-21T12:27:07.413 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-21T12:27:07.413 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-21T12:27:07.413 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-21T12:27:07.414 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: osd_pid0=163588 2026-02-21T12:27:07.414 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:465: TEST_bluestore_expand: wait_for_clean 2026-02-21T12:27:07.414 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-21T12:27:07.414 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-21T12:27:07.415 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-21T12:27:07.415 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-21T12:27:07.415 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-21T12:27:07.415 INFO:tasks.workunit.client.0.trial058.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-21T12:27:07.415 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-21T12:27:07.415 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-21T12:27:07.415 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-21T12:27:07.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-21T12:27:07.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-21T12:27:07.500 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-21T12:27:07.501 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-21T12:27:07.501 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: flush_pg_stats: local timeout=300 2026-02-21T12:27:07.501 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ceph osd ls 2026-02-21T12:27:07.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: flush_pg_stats: ids=0 2026-02-21T12:27:07.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: flush_pg_stats: seqs= 2026-02-21T12:27:07.730 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: flush_pg_stats: for osd in $ids 2026-02-21T12:27:07.730 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-21T12:27:07.800 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: flush_pg_stats: seq=55834574851 2026-02-21T12:27:07.800 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: flush_pg_stats: test -z 55834574851 2026-02-21T12:27:07.800 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: flush_pg_stats: seqs=' 0-55834574851' 2026-02-21T12:27:07.800 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: flush_pg_stats: for s in $seqs 2026-02-21T12:27:07.801 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: echo 0-55834574851 2026-02-21T12:27:07.801 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: cut -d - -f 1 2026-02-21T12:27:07.801 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: flush_pg_stats: osd=0 2026-02-21T12:27:07.802 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: echo 0-55834574851 2026-02-21T12:27:07.802 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: cut -d - -f 2 2026-02-21T12:27:07.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: flush_pg_stats: seq=55834574851 2026-02-21T12:27:07.803 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: flush_pg_stats: echo 'waiting osd.0 seq 55834574851' 2026-02-21T12:27:07.804 INFO:tasks.workunit.client.0.trial058.stdout:waiting osd.0 seq 55834574851 2026-02-21T12:27:07.804 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:27:08.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 1 -lt 55834574851 2026-02-21T12:27:08.035 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:27:09.036 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-21T12:27:09.037 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:27:09.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 1 -lt 55834574851 2026-02-21T12:27:09.266 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: flush_pg_stats: sleep 1 2026-02-21T12:27:10.267 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-21T12:27:10.267 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-21T12:27:10.501 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-21T12:27:10.502 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-21T12:27:10.502 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:27:10.502 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:27:10.823 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-21T12:27:10.823 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-21T12:27:10.824 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-21T12:27:10.824 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-21T12:27:10.824 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-21T12:27:10.824 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-21T12:27:10.824 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-21T12:27:10.824 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-21T12:27:11.055 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-21T12:27:11.056 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-21T12:27:11.056 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-21T12:27:11.056 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-21T12:27:11.375 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-21T12:27:11.376 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-21T12:27:11.376 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-21T12:27:11.376 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-21T12:27:11.377 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-21T12:27:11.447 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: total_space_after=4294967296 2026-02-21T12:27:11.447 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-21T12:27:11.448 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-21T12:27:11.448 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep free 2026-02-21T12:27:11.448 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d: -f 2 2026-02-21T12:27:11.448 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d, -f 1 2026-02-21T12:27:11.448 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-21T12:27:11.515 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: free_space_after=2574782464 2026-02-21T12:27:11.515 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:470: TEST_bluestore_expand: '[' 4294967296 '!=' 4294967296 ']' 2026-02-21T12:27:11.515 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:476: TEST_bluestore_expand: total_space_added=0 2026-02-21T12:27:11.515 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:477: TEST_bluestore_expand: free_space_added=-31367168 2026-02-21T12:27:11.515 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:479: TEST_bluestore_expand: let 'new_used_space=(0 - -31367168)' 2026-02-21T12:27:11.515 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:480: TEST_bluestore_expand: echo 31367168 2026-02-21T12:27:11.516 INFO:tasks.workunit.client.0.trial058.stdout:31367168 2026-02-21T12:27:11.516 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:482: TEST_bluestore_expand: '[' 31367168 -gt 131072 ']' 2026-02-21T12:27:11.516 INFO:tasks.workunit.client.0.trial058.stdout:total_space_added = 0 2026-02-21T12:27:11.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:483: TEST_bluestore_expand: echo 'total_space_added = 0' 2026-02-21T12:27:11.517 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:484: TEST_bluestore_expand: echo 'free_space_added = -31367168' 2026-02-21T12:27:11.517 INFO:tasks.workunit.client.0.trial058.stdout:free_space_added = -31367168 2026-02-21T12:27:11.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:485: TEST_bluestore_expand: return 1 2026-02-21T12:27:11.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: return 1 2026-02-21T12:27:11.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2431: main: code=1 2026-02-21T12:27:11.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2433: main: teardown td/osd-bluefs-volume-ops 1 2026-02-21T12:27:11.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-21T12:27:11.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=1 2026-02-21T12:27:11.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-21T12:27:11.519 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-21T12:27:11.519 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-21T12:27:11.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-21T12:27:11.519 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-21T12:27:11.520 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-21T12:27:11.621 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-21T12:27:11.622 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-21T12:27:11.623 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-21T12:27:11.623 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-21T12:27:11.625 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-21T12:27:11.625 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-21T12:27:11.625 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-21T12:27:11.626 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:27:11.627 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-21T12:27:11.627 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-21T12:27:11.627 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T12:27:11.628 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:27:11.629 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 1 = 1 ']' 2026-02-21T12:27:11.629 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:181: teardown: '[' -n '' ']' 2026-02-21T12:27:11.629 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:185: teardown: mkdir -p /home/ubuntu/cephtest/archive/log 2026-02-21T12:27:11.630 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:186: teardown: mv td/osd-bluefs-volume-ops/bluestore_tool.log td/osd-bluefs-volume-ops/mgr.x.log td/osd-bluefs-volume-ops/mon.a.log td/osd-bluefs-volume-ops/osd.0.log /home/ubuntu/cephtest/archive/log 2026-02-21T12:27:11.631 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-21T12:27:11.708 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-21T12:27:11.708 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-21T12:27:11.708 INFO:tasks.workunit.client.0.trial058.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108826 2026-02-21T12:27:11.708 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108826 2026-02-21T12:27:11.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-21T12:27:11.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-21T12:27:11.709 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2434: main: return 1 2026-02-21T12:27:11.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T12:27:11.711 INFO:tasks.workunit:Stopping ['osd'] on client.0... 2026-02-21T12:27:11.712 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-21T12:27:12.081 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_f7273f3049146bdd7fa7b4a400114872a50228e9/qa/tasks/workunit.py", line 144, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_f7273f3049146bdd7fa7b4a400114872a50228e9/qa/tasks/workunit.py", line 292, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_f7273f3049146bdd7fa7b4a400114872a50228e9/qa/tasks/workunit.py", line 433, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial058 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f7273f3049146bdd7fa7b4a400114872a50228e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh' 2026-02-21T12:27:12.083 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-21T12:27:12.094 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-21T12:27:12.094 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-21T12:27:12.199 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-21T12:27:12.209 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-21T12:27:12.209 DEBUG:teuthology.orchestra.run.trial058:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-21T12:27:12.225 INFO:teuthology.orchestra.run.trial058.stderr:bash: line 1: ntpq: command not found 2026-02-21T12:27:12.255 INFO:teuthology.orchestra.run.trial058.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-21T12:27:12.255 INFO:teuthology.orchestra.run.trial058.stdout:=============================================================================== 2026-02-21T12:27:12.255 INFO:teuthology.orchestra.run.trial058.stdout:^+ t1.time.gq1.yahoo.com 2 6 377 99 -29ms[ -29ms] +/- 69ms 2026-02-21T12:27:12.255 INFO:teuthology.orchestra.run.trial058.stdout:^* owners.kjsl.com 2 6 377 35 +8173us[+8182us] +/- 37ms 2026-02-21T12:27:12.255 INFO:teuthology.orchestra.run.trial058.stdout:^+ 23.186.168.131 2 6 377 26 +7659us[+7659us] +/- 55ms 2026-02-21T12:27:12.255 INFO:teuthology.orchestra.run.trial058.stdout:^+ 72-14-186-59.ip.linodeus> 2 7 377 36 +5181us[+5190us] +/- 91ms 2026-02-21T12:27:12.255 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-21T12:27:12.265 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-21T12:27:12.265 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-21T12:27:12.284 DEBUG:teuthology.orchestra.run.trial058:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-21T12:27:12.345 DEBUG:teuthology.orchestra.run.trial058:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-21T12:27:12.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T12:27:12.370 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-21T12:27:12.384 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-21T12:27:12.398 INFO:teuthology.task.internal:Duration was 1563.423809 seconds 2026-02-21T12:27:12.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-21T12:27:12.415 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-21T12:27:12.415 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-21T12:27:12.453 INFO:teuthology.orchestra.run.trial058.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-21T12:27:12.694 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-21T12:27:12.694 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial058.front.sepia.ceph.com 2026-02-21T12:27:12.694 DEBUG:teuthology.orchestra.run.trial058:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-21T12:27:12.752 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-21T12:27:12.753 DEBUG:teuthology.orchestra.run.trial058:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-21T12:27:12.853 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-21T12:27:12.853 DEBUG:teuthology.orchestra.run.trial058:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-21T12:27:12.876 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-21T12:27:12.876 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-21T12:27:12.877 INFO:teuthology.orchestra.run.trial058.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-21T12:27:12.877 INFO:teuthology.orchestra.run.trial058.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-21T12:27:12.877 INFO:teuthology.orchestra.run.trial058.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-21T12:27:12.886 INFO:teuthology.orchestra.run.trial058.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-21T12:27:12.888 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-21T12:27:12.902 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-21T12:27:12.902 DEBUG:teuthology.orchestra.run.trial058:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-21T12:27:12.954 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-21T12:27:12.970 DEBUG:teuthology.orchestra.run.trial058:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:27:13.019 INFO:teuthology.orchestra.run.trial058.stdout:kernel.core_pattern = core 2026-02-21T12:27:13.032 DEBUG:teuthology.orchestra.run.trial058:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-21T12:27:13.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T12:27:13.088 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-21T12:27:13.104 INFO:teuthology.task.internal:Transferring archived files... 2026-02-21T12:27:13.105 DEBUG:teuthology.misc:Transferring archived files from trial058:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-21_10:47:12-rados-wip-bharath21-testing-2026-02-20-1039-distro-default-trial/62644/remote/trial058 2026-02-21T12:27:13.106 DEBUG:teuthology.orchestra.run.trial058:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-21T13:25:32.862 INFO:teuthology.task.internal:Removing archive directory... 2026-02-21T13:25:32.869 DEBUG:teuthology.orchestra.run.trial058:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-21T13:25:37.128 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-21T13:25:37.147 INFO:teuthology.task.internal:Not uploading archives. 2026-02-21T13:25:37.147 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-21T13:25:37.163 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-21T13:25:37.163 DEBUG:teuthology.orchestra.run.trial058:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-21T13:25:37.180 INFO:teuthology.orchestra.run.trial058.stdout: 917572 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 21 13:25 /home/ubuntu/cephtest 2026-02-21T13:25:37.181 INFO:teuthology.orchestra.run.trial058.stdout: 1061673 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 21 12:05 /home/ubuntu/cephtest/mnt.0 2026-02-21T13:25:37.181 INFO:teuthology.orchestra.run.trial058.stdout: 1061674 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 21 12:15 /home/ubuntu/cephtest/mnt.0/client.0 2026-02-21T13:25:37.181 INFO:teuthology.orchestra.run.trial058.stdout: 1195506 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 21 12:15 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-21T13:25:37.181 INFO:teuthology.orchestra.run.trial058.stdout: 1195507 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 12:27 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td 2026-02-21T13:25:37.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T13:25:37.182 INFO:teuthology.orchestra.run.trial058.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-21T13:25:37.183 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial058 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-21T13:25:37.185 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-21T13:25:37.201 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-21T13:25:37.219 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial058 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-21T13:25:37.224 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} duration: 1563.4238090515137 failure_reason: 'Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial058 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f7273f3049146bdd7fa7b4a400114872a50228e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh''' flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-21T13:25:37.225 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T13:25:37.354 INFO:teuthology.run:FAIL