2026-02-18T01:10:54.528 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-18T01:10:54.543 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-18T01:10:54.617 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:14:21-rados-20.2.1_2.17.26-baseline_2-distro-default-trial/54269 branch: 20.2.1_2.17.26-baseline_2 description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '54269' kernel: branch: distro kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-17_21:14:21-rados-20.2.1_2.17.26-baseline_2-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: 20.2.1_2.17.26-baseline_2 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed workunit: branch: 20.2.1_2.17.26-baseline_2 sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 1775 sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: 20.2.1_2.17.26-baseline_2 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed targets: trial080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOGzOpbrJRCUU7PwhmdJ+Z60UIQShJubTDwtaTbSFkytHJ1nYsWIONlbzcEPbRy4DBhb18qzmZ68jwEFlyB4pcM= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_21:14:21 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-18T01:10:54.617 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa; will attempt to use it 2026-02-18T01:10:54.618 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa/tasks 2026-02-18T01:10:54.618 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-18T01:10:54.619 INFO:teuthology.task.internal:Checking packages... 2026-02-18T01:10:54.619 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'adc1923395f2bcd6ae89b5d331d278364d1848ed' 2026-02-18T01:10:54.619 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-18T01:10:54.620 INFO:teuthology.packaging:ref: None 2026-02-18T01:10:54.620 INFO:teuthology.packaging:tag: None 2026-02-18T01:10:54.620 INFO:teuthology.packaging:branch: 20.2.1_2.17.26-baseline_2 2026-02-18T01:10:54.620 INFO:teuthology.packaging:sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T01:10:54.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=20.2.1_2.17.26-baseline_2 2026-02-18T01:10:54.736 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-670-gadc19233-1jammy 2026-02-18T01:10:54.738 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-18T01:10:54.749 INFO:teuthology.task.internal:no buildpackages task found 2026-02-18T01:10:54.749 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-18T01:10:54.769 INFO:teuthology.task.internal:Saving configuration 2026-02-18T01:10:54.778 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-18T01:10:54.793 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-18T01:10:54.872 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial080.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:14:21-rados-20.2.1_2.17.26-baseline_2-distro-default-trial/54269', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 01:07:22.316696', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBO0I2FZwE85ht+Mr5uWPNL2hJNtgxox02Bu/SGPcUep'} 2026-02-18T01:10:54.872 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-18T01:10:54.882 INFO:teuthology.task.internal:roles: ubuntu@trial080.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-18T01:10:54.883 INFO:teuthology.run_tasks:Running task console_log... 2026-02-18T01:10:54.964 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd731bbf420>, signals=[15]) 2026-02-18T01:10:54.965 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-18T01:10:54.976 INFO:teuthology.task.internal:Opening connections... 2026-02-18T01:10:54.976 DEBUG:teuthology.task.internal:connecting to ubuntu@trial080.front.sepia.ceph.com 2026-02-18T01:10:54.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T01:10:55.045 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-18T01:10:55.058 DEBUG:teuthology.orchestra.run.trial080:> uname -m 2026-02-18T01:10:55.123 INFO:teuthology.orchestra.run.trial080.stdout:x86_64 2026-02-18T01:10:55.124 DEBUG:teuthology.orchestra.run.trial080:> cat /etc/os-release 2026-02-18T01:10:55.174 INFO:teuthology.orchestra.run.trial080.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-18T01:10:55.174 INFO:teuthology.orchestra.run.trial080.stdout:NAME="Ubuntu" 2026-02-18T01:10:55.174 INFO:teuthology.orchestra.run.trial080.stdout:VERSION_ID="22.04" 2026-02-18T01:10:55.174 INFO:teuthology.orchestra.run.trial080.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-18T01:10:55.174 INFO:teuthology.orchestra.run.trial080.stdout:VERSION_CODENAME=jammy 2026-02-18T01:10:55.174 INFO:teuthology.orchestra.run.trial080.stdout:ID=ubuntu 2026-02-18T01:10:55.174 INFO:teuthology.orchestra.run.trial080.stdout:ID_LIKE=debian 2026-02-18T01:10:55.174 INFO:teuthology.orchestra.run.trial080.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-18T01:10:55.174 INFO:teuthology.orchestra.run.trial080.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-18T01:10:55.174 INFO:teuthology.orchestra.run.trial080.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-18T01:10:55.174 INFO:teuthology.orchestra.run.trial080.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-18T01:10:55.175 INFO:teuthology.orchestra.run.trial080.stdout:UBUNTU_CODENAME=jammy 2026-02-18T01:10:55.175 INFO:teuthology.lock.ops:Updating trial080.front.sepia.ceph.com on lock server 2026-02-18T01:10:55.258 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-18T01:10:55.271 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-18T01:10:55.283 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-18T01:10:55.283 DEBUG:teuthology.orchestra.run.trial080:> test '!' -e /home/ubuntu/cephtest 2026-02-18T01:10:55.286 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-18T01:10:55.297 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-18T01:10:55.298 DEBUG:teuthology.orchestra.run.trial080:> test -z $(ls -A /var/lib/ceph) 2026-02-18T01:10:55.335 INFO:teuthology.orchestra.run.trial080.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-18T01:10:55.336 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-18T01:10:55.440 INFO:teuthology.run_tasks:Running task kernel... 2026-02-18T01:10:55.462 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-18T01:10:55.462 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-18T01:10:55.462 DEBUG:teuthology.orchestra.run.trial080:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T01:10:55.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T01:10:55.465 DEBUG:teuthology.orchestra.run.trial080:> uname -r 2026-02-18T01:10:55.510 INFO:teuthology.orchestra.run.trial080.stdout:5.15.0-164-generic 2026-02-18T01:10:55.511 INFO:teuthology.task.kernel:Running kernel on trial080: 5.15.0-164-generic 2026-02-18T01:10:55.511 DEBUG:teuthology.orchestra.run.trial080:> sudo apt-get clean 2026-02-18T01:10:55.572 DEBUG:teuthology.orchestra.run.trial080:> sudo apt-get update 2026-02-18T01:10:56.068 INFO:teuthology.orchestra.run.trial080.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-18T01:10:56.196 INFO:teuthology.orchestra.run.trial080.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-18T01:10:56.235 INFO:teuthology.orchestra.run.trial080.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-18T01:10:56.250 INFO:teuthology.orchestra.run.trial080.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-18T01:10:56.298 INFO:teuthology.orchestra.run.trial080.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3240 kB] 2026-02-18T01:10:56.361 INFO:teuthology.orchestra.run.trial080.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [494 kB] 2026-02-18T01:10:56.374 INFO:teuthology.orchestra.run.trial080.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.2 kB] 2026-02-18T01:10:56.383 INFO:teuthology.orchestra.run.trial080.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-18T01:10:56.399 INFO:teuthology.orchestra.run.trial080.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-18T01:10:56.410 INFO:teuthology.orchestra.run.trial080.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5295 kB] 2026-02-18T01:10:56.451 INFO:teuthology.orchestra.run.trial080.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1001 kB] 2026-02-18T01:10:56.465 INFO:teuthology.orchestra.run.trial080.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2975 kB] 2026-02-18T01:10:56.492 INFO:teuthology.orchestra.run.trial080.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-18T01:10:56.501 INFO:teuthology.orchestra.run.trial080.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-18T01:10:59.817 INFO:teuthology.orchestra.run.trial080.stdout:Fetched 16.0 MB in 2s (9842 kB/s) 2026-02-18T01:11:00.353 INFO:teuthology.orchestra.run.trial080.stdout:Reading package lists... 2026-02-18T01:11:00.366 DEBUG:teuthology.orchestra.run.trial080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-18T01:11:00.401 INFO:teuthology.orchestra.run.trial080.stdout:Reading package lists... 2026-02-18T01:11:00.510 INFO:teuthology.orchestra.run.trial080.stdout:Building dependency tree... 2026-02-18T01:11:00.511 INFO:teuthology.orchestra.run.trial080.stdout:Reading state information... 2026-02-18T01:11:00.599 INFO:teuthology.orchestra.run.trial080.stdout:The following packages were automatically installed and are no longer required: 2026-02-18T01:11:00.599 INFO:teuthology.orchestra.run.trial080.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-18T01:11:00.599 INFO:teuthology.orchestra.run.trial080.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-18T01:11:00.599 INFO:teuthology.orchestra.run.trial080.stdout: sg3-utils-udev 2026-02-18T01:11:00.599 INFO:teuthology.orchestra.run.trial080.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-18T01:11:00.599 INFO:teuthology.orchestra.run.trial080.stdout:The following additional packages will be installed: 2026-02-18T01:11:00.599 INFO:teuthology.orchestra.run.trial080.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-18T01:11:00.599 INFO:teuthology.orchestra.run.trial080.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-18T01:11:00.599 INFO:teuthology.orchestra.run.trial080.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-18T01:11:00.600 INFO:teuthology.orchestra.run.trial080.stdout:Suggested packages: 2026-02-18T01:11:00.600 INFO:teuthology.orchestra.run.trial080.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-18T01:11:00.613 INFO:teuthology.orchestra.run.trial080.stdout:The following NEW packages will be installed: 2026-02-18T01:11:00.613 INFO:teuthology.orchestra.run.trial080.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-18T01:11:00.613 INFO:teuthology.orchestra.run.trial080.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-18T01:11:00.613 INFO:teuthology.orchestra.run.trial080.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-18T01:11:00.614 INFO:teuthology.orchestra.run.trial080.stdout:The following packages will be upgraded: 2026-02-18T01:11:00.614 INFO:teuthology.orchestra.run.trial080.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-18T01:11:00.712 INFO:teuthology.orchestra.run.trial080.stdout:3 upgraded, 5 newly installed, 0 to remove and 53 not upgraded. 2026-02-18T01:11:00.712 INFO:teuthology.orchestra.run.trial080.stdout:Need to get 113 MB of archives. 2026-02-18T01:11:00.712 INFO:teuthology.orchestra.run.trial080.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-18T01:11:00.712 INFO:teuthology.orchestra.run.trial080.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-18T01:11:00.947 INFO:teuthology.orchestra.run.trial080.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-18T01:11:00.990 INFO:teuthology.orchestra.run.trial080.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-18T01:11:01.250 INFO:teuthology.orchestra.run.trial080.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-18T01:11:01.251 INFO:teuthology.orchestra.run.trial080.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-18T01:11:01.251 INFO:teuthology.orchestra.run.trial080.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-18T01:11:01.301 INFO:teuthology.orchestra.run.trial080.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-18T01:11:01.312 INFO:teuthology.orchestra.run.trial080.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-18T01:11:01.512 INFO:teuthology.orchestra.run.trial080.stdout:Fetched 113 MB in 1s (163 MB/s) 2026-02-18T01:11:01.533 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-18T01:11:01.701 INFO:teuthology.orchestra.run.trial080.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-18T01:11:01.703 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-18T01:11:01.704 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T01:11:02.052 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-18T01:11:02.058 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-18T01:11:02.076 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T01:11:02.115 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-18T01:11:02.122 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-18T01:11:02.122 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T01:11:03.222 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-18T01:11:03.222 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-18T01:11:03.244 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-18T01:11:03.245 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-18T01:11:03.261 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-18T01:11:03.268 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-18T01:11:03.269 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-18T01:11:04.641 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-18T01:11:04.653 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-18T01:11:04.653 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T01:11:05.236 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-18T01:11:05.237 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-18T01:11:05.262 INFO:teuthology.orchestra.run.trial080.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-18T01:11:05.262 INFO:teuthology.orchestra.run.trial080.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T01:11:05.264 INFO:teuthology.orchestra.run.trial080.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-18T01:11:05.265 INFO:teuthology.orchestra.run.trial080.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T01:11:06.042 INFO:teuthology.orchestra.run.trial080.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T01:11:06.881 INFO:teuthology.orchestra.run.trial080.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-18T01:11:06.882 INFO:teuthology.orchestra.run.trial080.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-18T01:11:06.887 INFO:teuthology.orchestra.run.trial080.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T01:11:07.689 INFO:teuthology.orchestra.run.trial080.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-18T01:11:07.690 INFO:teuthology.orchestra.run.trial080.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-18T01:11:07.691 INFO:teuthology.orchestra.run.trial080.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T01:11:07.696 INFO:teuthology.orchestra.run.trial080.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-18T01:11:07.696 INFO:teuthology.orchestra.run.trial080.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-18T01:11:14.806 INFO:teuthology.orchestra.run.trial080.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-18T01:11:21.369 INFO:teuthology.orchestra.run.trial080.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-18T01:11:21.369 INFO:teuthology.orchestra.run.trial080.stdout:Sourcing file `/etc/default/grub' 2026-02-18T01:11:21.388 INFO:teuthology.orchestra.run.trial080.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-18T01:11:21.389 INFO:teuthology.orchestra.run.trial080.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-18T01:11:21.391 INFO:teuthology.orchestra.run.trial080.stdout:Generating grub configuration file ... 2026-02-18T01:11:21.475 INFO:teuthology.orchestra.run.trial080.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-18T01:11:21.482 INFO:teuthology.orchestra.run.trial080.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-18T01:11:21.655 INFO:teuthology.orchestra.run.trial080.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-18T01:11:21.661 INFO:teuthology.orchestra.run.trial080.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-18T01:11:21.732 INFO:teuthology.orchestra.run.trial080.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-18T01:11:21.732 INFO:teuthology.orchestra.run.trial080.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-18T01:11:21.732 INFO:teuthology.orchestra.run.trial080.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-18T01:11:21.734 INFO:teuthology.orchestra.run.trial080.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T01:11:21.743 INFO:teuthology.orchestra.run.trial080.stdout:done 2026-02-18T01:11:22.157 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:11:22.157 INFO:teuthology.orchestra.run.trial080.stdout:Pending kernel upgrade! 2026-02-18T01:11:22.157 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:11:22.157 INFO:teuthology.orchestra.run.trial080.stdout:Running kernel version: 2026-02-18T01:11:22.157 INFO:teuthology.orchestra.run.trial080.stdout: 5.15.0-164-generic 2026-02-18T01:11:22.158 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:11:22.158 INFO:teuthology.orchestra.run.trial080.stdout:Diagnostics: 2026-02-18T01:11:22.158 INFO:teuthology.orchestra.run.trial080.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-18T01:11:22.158 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:11:22.158 INFO:teuthology.orchestra.run.trial080.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-18T01:11:22.158 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:11:22.158 INFO:teuthology.orchestra.run.trial080.stdout:The processor microcode seems to be up-to-date. 2026-02-18T01:11:22.158 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:11:22.158 INFO:teuthology.orchestra.run.trial080.stdout:No services need to be restarted. 2026-02-18T01:11:22.158 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:11:22.158 INFO:teuthology.orchestra.run.trial080.stdout:No containers need to be restarted. 2026-02-18T01:11:22.158 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:11:22.159 INFO:teuthology.orchestra.run.trial080.stdout:No user sessions are running outdated binaries. 2026-02-18T01:11:22.159 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:11:22.159 INFO:teuthology.orchestra.run.trial080.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-18T01:11:22.821 DEBUG:teuthology.orchestra.run.trial080:> dpkg -s linux-image-generic 2026-02-18T01:11:22.832 INFO:teuthology.orchestra.run.trial080.stdout:Package: linux-image-generic 2026-02-18T01:11:22.832 INFO:teuthology.orchestra.run.trial080.stdout:Status: install ok installed 2026-02-18T01:11:22.832 INFO:teuthology.orchestra.run.trial080.stdout:Priority: optional 2026-02-18T01:11:22.832 INFO:teuthology.orchestra.run.trial080.stdout:Section: kernel 2026-02-18T01:11:22.832 INFO:teuthology.orchestra.run.trial080.stdout:Installed-Size: 21 2026-02-18T01:11:22.832 INFO:teuthology.orchestra.run.trial080.stdout:Maintainer: Ubuntu Kernel Team 2026-02-18T01:11:22.832 INFO:teuthology.orchestra.run.trial080.stdout:Architecture: amd64 2026-02-18T01:11:22.832 INFO:teuthology.orchestra.run.trial080.stdout:Source: linux-meta 2026-02-18T01:11:22.833 INFO:teuthology.orchestra.run.trial080.stdout:Version: 5.15.0.170.159 2026-02-18T01:11:22.833 INFO:teuthology.orchestra.run.trial080.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-18T01:11:22.833 INFO:teuthology.orchestra.run.trial080.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-18T01:11:22.833 INFO:teuthology.orchestra.run.trial080.stdout:Recommends: thermald 2026-02-18T01:11:22.833 INFO:teuthology.orchestra.run.trial080.stdout:Description: Generic Linux kernel image 2026-02-18T01:11:22.833 INFO:teuthology.orchestra.run.trial080.stdout: This package will always depend on the latest generic kernel image 2026-02-18T01:11:22.833 INFO:teuthology.orchestra.run.trial080.stdout: available. 2026-02-18T01:11:22.834 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-18T01:11:22.834 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T01:11:22.835 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T01:11:22.835 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-18T01:11:22.835 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial080.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T01:11:22.835 DEBUG:teuthology.orchestra.run.trial080:> sudo apt-get clean 2026-02-18T01:11:22.915 DEBUG:teuthology.orchestra.run.trial080:> sudo apt-get update 2026-02-18T01:11:23.090 INFO:teuthology.orchestra.run.trial080.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-18T01:11:23.095 INFO:teuthology.orchestra.run.trial080.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-18T01:11:23.104 INFO:teuthology.orchestra.run.trial080.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-18T01:11:23.114 INFO:teuthology.orchestra.run.trial080.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-18T01:11:23.954 INFO:teuthology.orchestra.run.trial080.stdout:Reading package lists... 2026-02-18T01:11:23.968 DEBUG:teuthology.orchestra.run.trial080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-18T01:11:24.002 INFO:teuthology.orchestra.run.trial080.stdout:Reading package lists... 2026-02-18T01:11:24.115 INFO:teuthology.orchestra.run.trial080.stdout:Building dependency tree... 2026-02-18T01:11:24.116 INFO:teuthology.orchestra.run.trial080.stdout:Reading state information... 2026-02-18T01:11:24.203 INFO:teuthology.orchestra.run.trial080.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-18T01:11:24.204 INFO:teuthology.orchestra.run.trial080.stdout:linux-image-generic set to manually installed. 2026-02-18T01:11:24.204 INFO:teuthology.orchestra.run.trial080.stdout:The following packages were automatically installed and are no longer required: 2026-02-18T01:11:24.204 INFO:teuthology.orchestra.run.trial080.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-18T01:11:24.204 INFO:teuthology.orchestra.run.trial080.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-18T01:11:24.204 INFO:teuthology.orchestra.run.trial080.stdout: sg3-utils-udev 2026-02-18T01:11:24.204 INFO:teuthology.orchestra.run.trial080.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-18T01:11:24.224 INFO:teuthology.orchestra.run.trial080.stdout:0 upgraded, 0 newly installed, 0 to remove and 53 not upgraded. 2026-02-18T01:11:24.226 DEBUG:teuthology.orchestra.run.trial080:> dpkg -s linux-image-generic 2026-02-18T01:11:24.276 INFO:teuthology.orchestra.run.trial080.stdout:Package: linux-image-generic 2026-02-18T01:11:24.276 INFO:teuthology.orchestra.run.trial080.stdout:Status: install ok installed 2026-02-18T01:11:24.277 INFO:teuthology.orchestra.run.trial080.stdout:Priority: optional 2026-02-18T01:11:24.277 INFO:teuthology.orchestra.run.trial080.stdout:Section: kernel 2026-02-18T01:11:24.277 INFO:teuthology.orchestra.run.trial080.stdout:Installed-Size: 21 2026-02-18T01:11:24.277 INFO:teuthology.orchestra.run.trial080.stdout:Maintainer: Ubuntu Kernel Team 2026-02-18T01:11:24.277 INFO:teuthology.orchestra.run.trial080.stdout:Architecture: amd64 2026-02-18T01:11:24.277 INFO:teuthology.orchestra.run.trial080.stdout:Source: linux-meta 2026-02-18T01:11:24.277 INFO:teuthology.orchestra.run.trial080.stdout:Version: 5.15.0.170.159 2026-02-18T01:11:24.277 INFO:teuthology.orchestra.run.trial080.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-18T01:11:24.277 INFO:teuthology.orchestra.run.trial080.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-18T01:11:24.277 INFO:teuthology.orchestra.run.trial080.stdout:Recommends: thermald 2026-02-18T01:11:24.277 INFO:teuthology.orchestra.run.trial080.stdout:Description: Generic Linux kernel image 2026-02-18T01:11:24.278 INFO:teuthology.orchestra.run.trial080.stdout: This package will always depend on the latest generic kernel image 2026-02-18T01:11:24.278 INFO:teuthology.orchestra.run.trial080.stdout: available. 2026-02-18T01:11:24.278 DEBUG:teuthology.orchestra.run.trial080:> mktemp 2026-02-18T01:11:24.323 INFO:teuthology.orchestra.run.trial080.stdout:/tmp/tmp.PSFGpZmhvV 2026-02-18T01:11:24.324 DEBUG:teuthology.orchestra.run.trial080:> sudo cp /boot/grub/grub.cfg /tmp/tmp.PSFGpZmhvV 2026-02-18T01:11:24.372 DEBUG:teuthology.orchestra.run.trial080:> sudo chmod 0666 /tmp/tmp.PSFGpZmhvV 2026-02-18T01:11:24.470 DEBUG:teuthology.orchestra.remote:trial080:/tmp/tmp.PSFGpZmhvV is 7KB 2026-02-18T01:11:24.478 DEBUG:teuthology.orchestra.run.trial080:> rm -fr /tmp/tmp.PSFGpZmhvV 2026-02-18T01:11:24.482 DEBUG:teuthology.orchestra.run.trial080:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-18T01:11:24.531 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-18T01:11:24.531 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-18T01:11:24.531 DEBUG:teuthology.orchestra.run.trial080:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-18T01:11:24.585 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-18T01:11:24.585 DEBUG:teuthology.orchestra.run.trial080:> sudo update-grub 2026-02-18T01:11:24.814 INFO:teuthology.orchestra.run.trial080.stderr:Sourcing file `/etc/default/grub' 2026-02-18T01:11:24.834 INFO:teuthology.orchestra.run.trial080.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-18T01:11:24.834 INFO:teuthology.orchestra.run.trial080.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-18T01:11:24.837 INFO:teuthology.orchestra.run.trial080.stderr:Generating grub configuration file ... 2026-02-18T01:11:24.920 INFO:teuthology.orchestra.run.trial080.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-18T01:11:24.925 INFO:teuthology.orchestra.run.trial080.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-18T01:11:25.098 INFO:teuthology.orchestra.run.trial080.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-18T01:11:25.103 INFO:teuthology.orchestra.run.trial080.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-18T01:11:25.173 INFO:teuthology.orchestra.run.trial080.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-18T01:11:25.173 INFO:teuthology.orchestra.run.trial080.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-18T01:11:25.173 INFO:teuthology.orchestra.run.trial080.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-18T01:11:25.175 INFO:teuthology.orchestra.run.trial080.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T01:11:25.183 INFO:teuthology.orchestra.run.trial080.stderr:done 2026-02-18T01:11:25.184 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial080 2026-02-18T01:11:25.185 DEBUG:teuthology.orchestra.run.trial080:> sudo bash -c ' 2026-02-18T01:11:25.185 DEBUG:teuthology.orchestra.run.trial080:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T01:11:25.185 DEBUG:teuthology.orchestra.run.trial080:> ' 2026-02-18T01:11:55.188 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-18T01:11:55.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial080.front.sepia.ceph.com' 2026-02-18T01:11:55.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T01:12:55.228 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T01:13:04.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial080.front.sepia.ceph.com' 2026-02-18T01:13:04.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T01:13:04.360 DEBUG:teuthology.orchestra.run.trial080:> true 2026-02-18T01:13:04.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial080.front.sepia.ceph.com' 2026-02-18T01:13:04.754 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-18T01:13:04.754 DEBUG:teuthology.orchestra.run.trial080:> uname -r 2026-02-18T01:13:04.800 INFO:teuthology.orchestra.run.trial080.stdout:5.15.0-170-generic 2026-02-18T01:13:04.800 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-18T01:13:04.800 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T01:13:04.800 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-18T01:13:05.802 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-18T01:13:05.802 DEBUG:teuthology.orchestra.run.trial080:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T01:13:05.815 INFO:teuthology.orchestra.run.trial080.stdout:ttyS1 2026-02-18T01:13:05.842 DEBUG:teuthology.parallel:result is None 2026-02-18T01:13:05.843 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-18T01:13:05.854 INFO:teuthology.task.internal:Creating test directory... 2026-02-18T01:13:05.855 DEBUG:teuthology.orchestra.run.trial080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T01:13:05.888 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-18T01:13:05.900 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-18T01:13:05.914 INFO:teuthology.task.internal:Creating archive directory... 2026-02-18T01:13:05.914 DEBUG:teuthology.orchestra.run.trial080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T01:13:05.938 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-18T01:13:05.950 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-18T01:13:05.951 DEBUG:teuthology.orchestra.run.trial080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T01:13:05.985 INFO:teuthology.orchestra.run.trial080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:13:05.991 INFO:teuthology.orchestra.run.trial080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:13:05.992 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-18T01:13:06.003 INFO:teuthology.task.internal:Configuring sudo... 2026-02-18T01:13:06.003 DEBUG:teuthology.orchestra.run.trial080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T01:13:06.043 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-18T01:13:06.056 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-18T01:13:06.056 DEBUG:teuthology.orchestra.run.trial080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T01:13:06.088 DEBUG:teuthology.orchestra.run.trial080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T01:13:06.131 DEBUG:teuthology.orchestra.run.trial080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T01:13:06.180 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-18T01:13:06.180 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T01:13:06.229 DEBUG:teuthology.orchestra.run.trial080:> sudo service rsyslog restart 2026-02-18T01:13:06.290 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-18T01:13:06.303 INFO:teuthology.task.internal:Starting timer... 2026-02-18T01:13:06.303 INFO:teuthology.run_tasks:Running task pcp... 2026-02-18T01:13:06.325 INFO:teuthology.run_tasks:Running task selinux... 2026-02-18T01:13:06.344 DEBUG:teuthology.task.selinux:Excluding trial080: OS 'ubuntu' does not support SELinux 2026-02-18T01:13:06.344 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-18T01:13:06.344 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-18T01:13:06.344 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-18T01:13:06.344 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-18T01:13:06.360 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-18T01:13:06.372 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-18T01:13:06.373 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial080.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-18T01:14:07.280 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial080.front.sepia.ceph.com')] 2026-02-18T01:14:07.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial080.front.sepia.ceph.com' 2026-02-18T01:14:07.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T01:14:07.370 DEBUG:teuthology.orchestra.run.trial080:> true 2026-02-18T01:14:07.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial080.front.sepia.ceph.com' 2026-02-18T01:14:07.618 INFO:teuthology.run_tasks:Running task clock... 2026-02-18T01:14:07.629 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-18T01:14:07.629 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T01:14:07.630 DEBUG:teuthology.orchestra.run.trial080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T01:14:07.681 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-18T01:14:07.681 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: Command line: ntpd -gq 2026-02-18T01:14:07.681 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: ---------------------------------------------------- 2026-02-18T01:14:07.681 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: ntp-4 is maintained by Network Time Foundation, 2026-02-18T01:14:07.681 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-18T01:14:07.682 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: corporation. Support and training for ntp-4 are 2026-02-18T01:14:07.682 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: available at https://www.nwtime.org/support 2026-02-18T01:14:07.682 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: ---------------------------------------------------- 2026-02-18T01:14:07.682 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: proto: precision = 0.030 usec (-25) 2026-02-18T01:14:07.682 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: basedate set to 2022-02-04 2026-02-18T01:14:07.682 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: gps base set to 2022-02-06 (week 2196) 2026-02-18T01:14:07.682 INFO:teuthology.orchestra.run.trial080.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-18T01:14:07.683 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-18T01:14:07.683 INFO:teuthology.orchestra.run.trial080.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-18T01:14:07.684 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: restrict ::: KOD does nothing without LIMITED. 2026-02-18T01:14:07.684 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: Listen and drop on 0 v6wildcard [::]:123 2026-02-18T01:14:07.684 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-18T01:14:07.684 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: Listen normally on 2 lo 127.0.0.1:123 2026-02-18T01:14:07.684 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: Listen normally on 3 enp1s0f0 10.20.193.80:123 2026-02-18T01:14:07.684 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: Listen normally on 4 lo [::1]:123 2026-02-18T01:14:07.684 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:6484%2]:123 2026-02-18T01:14:07.684 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:07 ntpd[4917]: Listening on routing socket on fd #22 for interface updates 2026-02-18T01:14:08.681 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:08 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:08.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:08 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:08.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:08 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:08.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:08 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:08.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:08 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:08.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:08 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:08.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:08 ntpd[4917]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T01:14:08.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:08 ntpd[4917]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T01:14:08.753 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:08 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:08.753 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:08 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:08.753 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:08 ntpd[4917]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T01:14:08.753 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:08 ntpd[4917]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T01:14:10.681 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:10.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:10.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:10.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:10.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:10.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:10.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:10.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:10.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T01:14:10.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T01:14:10.746 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:10.747 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:10.747 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T01:14:10.747 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T01:14:10.753 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:10.753 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:10.753 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T01:14:10.753 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:10 ntpd[4917]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T01:14:11.681 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:11 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:11.681 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:11 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:11.687 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:11 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:11.687 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:11 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:11.687 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:11 ntpd[4917]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T01:14:11.687 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:11 ntpd[4917]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T01:14:12.681 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:12.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:12.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:12.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:12.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:12.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:12.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:12.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:12.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T01:14:12.702 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T01:14:12.746 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:12.746 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:12.747 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T01:14:12.747 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T01:14:12.753 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:12.753 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:12.753 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T01:14:12.753 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:12 ntpd[4917]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T01:14:13.681 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:13 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:13.681 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:13 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:13.684 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:13 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:13.684 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:13 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:13.684 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:13 ntpd[4917]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T01:14:13.684 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:13 ntpd[4917]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T01:14:14.681 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:14 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:14.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:14 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:14.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:14 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:14.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:14 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:14.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:14 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:14.682 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:14 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:14.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:14 ntpd[4917]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T01:14:14.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:14 ntpd[4917]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T01:14:14.701 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:14 ntpd[4917]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T01:14:14.702 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:14 ntpd[4917]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T01:14:14.702 INFO:teuthology.orchestra.run.trial080.stdout:18 Feb 01:14:14 ntpd[4917]: ntpd: time set +0.084021 s 2026-02-18T01:14:14.702 INFO:teuthology.orchestra.run.trial080.stdout:ntpd: time set +0.084021s 2026-02-18T01:14:14.702 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:14 ntpd[4917]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-18T01:14:14.703 INFO:teuthology.orchestra.run.trial080.stderr:18 Feb 01:14:14 ntpd[4917]: can't open /var/log/ntpstats/loopstats.20260218: Permission denied 2026-02-18T01:14:14.773 INFO:teuthology.orchestra.run.trial080.stdout: remote refid st t when poll reach delay offset jitter 2026-02-18T01:14:14.773 INFO:teuthology.orchestra.run.trial080.stdout:============================================================================== 2026-02-18T01:14:14.773 INFO:teuthology.orchestra.run.trial080.stdout: 108.61.73.243 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-18T01:14:14.773 INFO:teuthology.orchestra.run.trial080.stdout: 149.248.12.167 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-18T01:14:14.773 INFO:teuthology.orchestra.run.trial080.stdout: 173.10.119.145 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-18T01:14:14.773 INFO:teuthology.orchestra.run.trial080.stdout: 216.82.35.115 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-18T01:14:14.775 INFO:teuthology.run_tasks:Running task install... 2026-02-18T01:14:14.789 DEBUG:teuthology.task.install:project ceph 2026-02-18T01:14:14.789 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed'}} 2026-02-18T01:14:14.790 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed'} 2026-02-18T01:14:14.790 INFO:teuthology.task.install:Using flavor: default 2026-02-18T01:14:14.794 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-18T01:14:14.794 INFO:teuthology.task.install:extra packages: [] 2026-02-18T01:14:14.794 DEBUG:teuthology.orchestra.run.trial080:> sudo apt-key list | grep Ceph 2026-02-18T01:14:14.864 INFO:teuthology.orchestra.run.trial080.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-18T01:14:14.893 INFO:teuthology.orchestra.run.trial080.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-18T01:14:14.893 INFO:teuthology.orchestra.run.trial080.stdout:uid [ unknown] Ceph.com (release key) 2026-02-18T01:14:14.893 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-18T01:14:14.893 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T01:14:15.010 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default/ 2026-02-18T01:14:15.010 INFO:teuthology.task.install.deb:Package version is 20.2.0-670-gadc19233-1jammy 2026-02-18T01:14:15.324 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-18T01:14:15.324 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-18T01:14:15.334 DEBUG:teuthology.orchestra.run.trial080:> sudo apt-get update 2026-02-18T01:14:15.657 INFO:teuthology.orchestra.run.trial080.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy InRelease 2026-02-18T01:14:15.714 INFO:teuthology.orchestra.run.trial080.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy Release [7680 B] 2026-02-18T01:14:15.772 INFO:teuthology.orchestra.run.trial080.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-18T01:14:15.772 INFO:teuthology.orchestra.run.trial080.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-18T01:14:15.829 INFO:teuthology.orchestra.run.trial080.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.8 kB] 2026-02-18T01:14:15.841 INFO:teuthology.orchestra.run.trial080.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-18T01:14:15.911 INFO:teuthology.orchestra.run.trial080.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-18T01:14:15.983 INFO:teuthology.orchestra.run.trial080.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-18T01:14:16.130 INFO:teuthology.orchestra.run.trial080.stdout:Fetched 26.5 kB in 1s (42.2 kB/s) 2026-02-18T01:14:16.658 INFO:teuthology.orchestra.run.trial080.stdout:Reading package lists... 2026-02-18T01:14:16.672 DEBUG:teuthology.orchestra.run.trial080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.2.0-670-gadc19233-1jammy cephadm=20.2.0-670-gadc19233-1jammy ceph-mds=20.2.0-670-gadc19233-1jammy ceph-mgr=20.2.0-670-gadc19233-1jammy ceph-common=20.2.0-670-gadc19233-1jammy ceph-fuse=20.2.0-670-gadc19233-1jammy ceph-test=20.2.0-670-gadc19233-1jammy ceph-volume=20.2.0-670-gadc19233-1jammy radosgw=20.2.0-670-gadc19233-1jammy python3-rados=20.2.0-670-gadc19233-1jammy python3-rgw=20.2.0-670-gadc19233-1jammy python3-cephfs=20.2.0-670-gadc19233-1jammy python3-rbd=20.2.0-670-gadc19233-1jammy libcephfs2=20.2.0-670-gadc19233-1jammy libcephfs-dev=20.2.0-670-gadc19233-1jammy librados2=20.2.0-670-gadc19233-1jammy librbd1=20.2.0-670-gadc19233-1jammy rbd-fuse=20.2.0-670-gadc19233-1jammy 2026-02-18T01:14:16.706 INFO:teuthology.orchestra.run.trial080.stdout:Reading package lists... 2026-02-18T01:14:16.814 INFO:teuthology.orchestra.run.trial080.stdout:Building dependency tree... 2026-02-18T01:14:16.815 INFO:teuthology.orchestra.run.trial080.stdout:Reading state information... 2026-02-18T01:14:16.903 INFO:teuthology.orchestra.run.trial080.stdout:The following packages were automatically installed and are no longer required: 2026-02-18T01:14:16.903 INFO:teuthology.orchestra.run.trial080.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: sg3-utils-udev 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout:The following additional packages will be installed: 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: libcephfs-daemon libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: liblttng-ust1 libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: python3-asyncssh python3-cachetools python3-ceph-argparse 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: python3-ceph-common python3-cheroot python3-cherrypy3 python3-google-auth 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco.functools python3-jaraco.text python3-joblib 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: python3-kubernetes python3-natsort python3-pluggy python3-portend 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: python3-rsa python3-simplejson python3-sklearn python3-sklearn-lib 2026-02-18T01:14:16.904 INFO:teuthology.orchestra.run.trial080.stdout: python3-tempora python3-threadpoolctl python3-toml python3-wcwidth 2026-02-18T01:14:16.905 INFO:teuthology.orchestra.run.trial080.stdout: python3-webob python3-websocket python3-zc.lockfile qttranslations5-l10n 2026-02-18T01:14:16.905 INFO:teuthology.orchestra.run.trial080.stdout: socat xmlstarlet 2026-02-18T01:14:16.905 INFO:teuthology.orchestra.run.trial080.stdout:Suggested packages: 2026-02-18T01:14:16.905 INFO:teuthology.orchestra.run.trial080.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-18T01:14:16.905 INFO:teuthology.orchestra.run.trial080.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-18T01:14:16.905 INFO:teuthology.orchestra.run.trial080.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-18T01:14:16.905 INFO:teuthology.orchestra.run.trial080.stdout:Recommended packages: 2026-02-18T01:14:16.905 INFO:teuthology.orchestra.run.trial080.stdout: btrfs-tools 2026-02-18T01:14:16.938 INFO:teuthology.orchestra.run.trial080.stdout:The following NEW packages will be installed: 2026-02-18T01:14:16.938 INFO:teuthology.orchestra.run.trial080.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-18T01:14:16.938 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-18T01:14:16.938 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-18T01:14:16.938 INFO:teuthology.orchestra.run.trial080.stdout: libcephfs-daemon libcephfs-dev libcephfs-proxy2 libcephfs2 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 liboath0 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-18T01:14:16.939 INFO:teuthology.orchestra.run.trial080.stdout: socat xmlstarlet 2026-02-18T01:14:17.255 INFO:teuthology.orchestra.run.trial080.stdout:0 upgraded, 86 newly installed, 0 to remove and 53 not upgraded. 2026-02-18T01:14:17.255 INFO:teuthology.orchestra.run.trial080.stdout:Need to get 280 MB of archives. 2026-02-18T01:14:17.255 INFO:teuthology.orchestra.run.trial080.stdout:After this operation, 1119 MB of additional disk space will be used. 2026-02-18T01:14:17.255 INFO:teuthology.orchestra.run.trial080.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.2.0-670-gadc19233-1jammy [3561 kB] 2026-02-18T01:14:17.293 INFO:teuthology.orchestra.run.trial080.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-18T01:14:17.628 INFO:teuthology.orchestra.run.trial080.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-18T01:14:17.639 INFO:teuthology.orchestra.run.trial080.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-18T01:14:17.709 INFO:teuthology.orchestra.run.trial080.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-18T01:14:17.820 INFO:teuthology.orchestra.run.trial080.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.2.0-670-gadc19233-1jammy [2867 kB] 2026-02-18T01:14:17.910 INFO:teuthology.orchestra.run.trial080.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-18T01:14:17.920 INFO:teuthology.orchestra.run.trial080.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-18T01:14:17.947 INFO:teuthology.orchestra.run.trial080.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-18T01:14:17.955 INFO:teuthology.orchestra.run.trial080.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-18T01:14:17.957 INFO:teuthology.orchestra.run.trial080.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-18T01:14:17.957 INFO:teuthology.orchestra.run.trial080.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-18T01:14:17.959 INFO:teuthology.orchestra.run.trial080.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-18T01:14:17.975 INFO:teuthology.orchestra.run.trial080.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-18T01:14:17.975 INFO:teuthology.orchestra.run.trial080.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-18T01:14:17.982 INFO:teuthology.orchestra.run.trial080.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-18T01:14:18.018 INFO:teuthology.orchestra.run.trial080.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.2.0-670-gadc19233-1jammy [833 kB] 2026-02-18T01:14:18.048 INFO:teuthology.orchestra.run.trial080.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-18T01:14:18.048 INFO:teuthology.orchestra.run.trial080.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-18T01:14:18.049 INFO:teuthology.orchestra.run.trial080.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-18T01:14:18.049 INFO:teuthology.orchestra.run.trial080.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-18T01:14:18.049 INFO:teuthology.orchestra.run.trial080.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-18T01:14:18.049 INFO:teuthology.orchestra.run.trial080.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-18T01:14:18.050 INFO:teuthology.orchestra.run.trial080.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-18T01:14:18.053 INFO:teuthology.orchestra.run.trial080.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-18T01:14:18.054 INFO:teuthology.orchestra.run.trial080.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-18T01:14:18.125 INFO:teuthology.orchestra.run.trial080.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-18T01:14:18.128 INFO:teuthology.orchestra.run.trial080.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-18T01:14:18.129 INFO:teuthology.orchestra.run.trial080.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-18T01:14:18.129 INFO:teuthology.orchestra.run.trial080.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-18T01:14:18.130 INFO:teuthology.orchestra.run.trial080.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.2.0-670-gadc19233-1jammy [364 kB] 2026-02-18T01:14:18.137 INFO:teuthology.orchestra.run.trial080.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.2.0-670-gadc19233-1jammy [32.8 kB] 2026-02-18T01:14:18.137 INFO:teuthology.orchestra.run.trial080.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.2.0-670-gadc19233-1jammy [184 kB] 2026-02-18T01:14:18.141 INFO:teuthology.orchestra.run.trial080.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.2.0-670-gadc19233-1jammy [83.9 kB] 2026-02-18T01:14:18.142 INFO:teuthology.orchestra.run.trial080.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.2.0-670-gadc19233-1jammy [341 kB] 2026-02-18T01:14:18.155 INFO:teuthology.orchestra.run.trial080.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-18T01:14:18.157 INFO:teuthology.orchestra.run.trial080.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-18T01:14:18.157 INFO:teuthology.orchestra.run.trial080.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-18T01:14:18.197 INFO:teuthology.orchestra.run.trial080.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.2.0-670-gadc19233-1jammy [8687 kB] 2026-02-18T01:14:18.216 INFO:teuthology.orchestra.run.trial080.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-18T01:14:18.216 INFO:teuthology.orchestra.run.trial080.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-18T01:14:18.217 INFO:teuthology.orchestra.run.trial080.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-18T01:14:18.269 INFO:teuthology.orchestra.run.trial080.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-18T01:14:18.269 INFO:teuthology.orchestra.run.trial080.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-18T01:14:18.270 INFO:teuthology.orchestra.run.trial080.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-18T01:14:18.274 INFO:teuthology.orchestra.run.trial080.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-18T01:14:18.275 INFO:teuthology.orchestra.run.trial080.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-18T01:14:18.278 INFO:teuthology.orchestra.run.trial080.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-18T01:14:18.341 INFO:teuthology.orchestra.run.trial080.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-18T01:14:18.344 INFO:teuthology.orchestra.run.trial080.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-18T01:14:18.346 INFO:teuthology.orchestra.run.trial080.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-18T01:14:18.349 INFO:teuthology.orchestra.run.trial080.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-18T01:14:18.413 INFO:teuthology.orchestra.run.trial080.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-18T01:14:18.413 INFO:teuthology.orchestra.run.trial080.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-18T01:14:18.413 INFO:teuthology.orchestra.run.trial080.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-18T01:14:18.414 INFO:teuthology.orchestra.run.trial080.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-18T01:14:18.415 INFO:teuthology.orchestra.run.trial080.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-18T01:14:18.421 INFO:teuthology.orchestra.run.trial080.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-18T01:14:18.484 INFO:teuthology.orchestra.run.trial080.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-18T01:14:18.486 INFO:teuthology.orchestra.run.trial080.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-18T01:14:18.487 INFO:teuthology.orchestra.run.trial080.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-18T01:14:18.487 INFO:teuthology.orchestra.run.trial080.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-18T01:14:18.906 INFO:teuthology.orchestra.run.trial080.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.2.0-670-gadc19233-1jammy [112 kB] 2026-02-18T01:14:18.907 INFO:teuthology.orchestra.run.trial080.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.2.0-670-gadc19233-1jammy [261 kB] 2026-02-18T01:14:18.910 INFO:teuthology.orchestra.run.trial080.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.2.0-670-gadc19233-1jammy [29.3 MB] 2026-02-18T01:14:21.067 INFO:teuthology.orchestra.run.trial080.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.2.0-670-gadc19233-1jammy [5416 kB] 2026-02-18T01:14:21.327 INFO:teuthology.orchestra.run.trial080.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.2.0-670-gadc19233-1jammy [246 kB] 2026-02-18T01:14:21.331 INFO:teuthology.orchestra.run.trial080.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.2.0-670-gadc19233-1jammy [124 kB] 2026-02-18T01:14:21.334 INFO:teuthology.orchestra.run.trial080.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.2.0-670-gadc19233-1jammy [907 kB] 2026-02-18T01:14:21.378 INFO:teuthology.orchestra.run.trial080.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.2.0-670-gadc19233-1jammy [6397 kB] 2026-02-18T01:14:21.692 INFO:teuthology.orchestra.run.trial080.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.2.0-670-gadc19233-1jammy [21.7 MB] 2026-02-18T01:14:22.715 INFO:teuthology.orchestra.run.trial080.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.2.0-670-gadc19233-1jammy [14.1 kB] 2026-02-18T01:14:22.715 INFO:teuthology.orchestra.run.trial080.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.2.0-670-gadc19233-1jammy [957 kB] 2026-02-18T01:14:22.757 INFO:teuthology.orchestra.run.trial080.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.2.0-670-gadc19233-1jammy [2345 kB] 2026-02-18T01:14:22.858 INFO:teuthology.orchestra.run.trial080.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.2.0-670-gadc19233-1jammy [1049 kB] 2026-02-18T01:14:22.905 INFO:teuthology.orchestra.run.trial080.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.2.0-670-gadc19233-1jammy [179 kB] 2026-02-18T01:14:22.908 INFO:teuthology.orchestra.run.trial080.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.2.0-670-gadc19233-1jammy [45.5 MB] 2026-02-18T01:14:25.038 INFO:teuthology.orchestra.run.trial080.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.2.0-670-gadc19233-1jammy [8625 kB] 2026-02-18T01:14:25.423 INFO:teuthology.orchestra.run.trial080.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.2.0-670-gadc19233-1jammy [14.2 kB] 2026-02-18T01:14:25.423 INFO:teuthology.orchestra.run.trial080.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.2.0-670-gadc19233-1jammy [99.5 MB] 2026-02-18T01:14:28.412 INFO:teuthology.orchestra.run.trial080.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.2.0-670-gadc19233-1jammy [135 kB] 2026-02-18T01:14:28.413 INFO:teuthology.orchestra.run.trial080.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.2.0-670-gadc19233-1jammy [43.3 kB] 2026-02-18T01:14:28.413 INFO:teuthology.orchestra.run.trial080.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.2.0-670-gadc19233-1jammy [30.7 kB] 2026-02-18T01:14:28.413 INFO:teuthology.orchestra.run.trial080.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.2.0-670-gadc19233-1jammy [41.5 kB] 2026-02-18T01:14:28.413 INFO:teuthology.orchestra.run.trial080.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.2.0-670-gadc19233-1jammy [25.1 MB] 2026-02-18T01:14:29.135 INFO:teuthology.orchestra.run.trial080.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.2.0-670-gadc19233-1jammy [97.5 kB] 2026-02-18T01:14:29.416 INFO:teuthology.orchestra.run.trial080.stdout:Fetched 280 MB in 12s (23.0 MB/s) 2026-02-18T01:14:29.433 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-18T01:14:29.588 INFO:teuthology.orchestra.run.trial080.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-18T01:14:29.590 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-18T01:14:29.591 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-18T01:14:29.612 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-18T01:14:29.623 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-18T01:14:29.623 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-18T01:14:29.638 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-18T01:14:29.650 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-18T01:14:29.650 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-18T01:14:29.669 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-18T01:14:29.677 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-18T01:14:29.682 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-18T01:14:29.713 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-18T01:14:29.721 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-18T01:14:29.721 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-18T01:14:29.737 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-18T01:14:29.745 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-18T01:14:29.745 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-18T01:14:29.765 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-18T01:14:29.773 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-18T01:14:29.773 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-18T01:14:29.788 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package librados2. 2026-02-18T01:14:29.797 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../07-librados2_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:29.797 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking librados2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:29.837 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libnbd0. 2026-02-18T01:14:29.845 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-18T01:14:29.845 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-18T01:14:29.859 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package librbd1. 2026-02-18T01:14:29.867 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../09-librbd1_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:29.868 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking librbd1 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:29.905 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libcephfs2. 2026-02-18T01:14:29.914 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../10-libcephfs2_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:29.914 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libcephfs2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:29.933 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-rados. 2026-02-18T01:14:29.942 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../11-python3-rados_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:29.942 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-rados (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:29.959 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-18T01:14:29.967 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T01:14:29.968 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-ceph-argparse (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:29.981 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-cephfs. 2026-02-18T01:14:29.989 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../13-python3-cephfs_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:29.990 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-cephfs (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:30.004 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-18T01:14:30.012 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../14-python3-ceph-common_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T01:14:30.013 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-ceph-common (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:30.030 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-18T01:14:30.038 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-18T01:14:30.039 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-18T01:14:30.055 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-prettytable. 2026-02-18T01:14:30.063 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-18T01:14:30.064 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-18T01:14:30.078 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-rbd. 2026-02-18T01:14:30.086 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../17-python3-rbd_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:30.087 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-rbd (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:30.104 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-18T01:14:30.112 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-18T01:14:30.113 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-18T01:14:30.130 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package librgw2. 2026-02-18T01:14:30.138 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../19-librgw2_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:30.139 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking librgw2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:30.231 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-rgw. 2026-02-18T01:14:30.240 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../20-python3-rgw_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:30.240 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-rgw (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:30.255 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-18T01:14:30.263 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-18T01:14:30.263 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-18T01:14:30.278 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libradosstriper1. 2026-02-18T01:14:30.286 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../22-libradosstriper1_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:30.287 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libradosstriper1 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:30.303 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-common. 2026-02-18T01:14:30.311 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../23-ceph-common_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:30.312 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-common (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:30.556 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-base. 2026-02-18T01:14:30.565 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../24-ceph-base_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:30.570 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-base (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:30.634 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-18T01:14:30.642 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-18T01:14:30.643 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-18T01:14:30.657 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-cheroot. 2026-02-18T01:14:30.666 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-18T01:14:30.667 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-18T01:14:30.684 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-18T01:14:30.692 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-18T01:14:30.692 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-18T01:14:30.707 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-18T01:14:30.715 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-18T01:14:30.716 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-18T01:14:30.730 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-18T01:14:30.738 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-18T01:14:30.739 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-18T01:14:30.753 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-tempora. 2026-02-18T01:14:30.761 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-18T01:14:30.761 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-18T01:14:30.775 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-portend. 2026-02-18T01:14:30.784 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-18T01:14:30.784 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-18T01:14:30.798 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-18T01:14:30.806 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-18T01:14:30.806 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-18T01:14:30.821 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-18T01:14:30.829 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-18T01:14:30.830 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-18T01:14:30.854 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-natsort. 2026-02-18T01:14:30.862 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-18T01:14:30.862 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-18T01:14:30.878 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-18T01:14:30.886 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T01:14:30.887 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-mgr-modules-core (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:30.913 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-18T01:14:30.922 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:30.922 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libsqlite3-mod-ceph (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:30.937 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-mgr. 2026-02-18T01:14:30.945 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../37-ceph-mgr_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:30.945 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-mgr (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:30.966 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-mon. 2026-02-18T01:14:30.974 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../38-ceph-mon_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:30.975 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-mon (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:31.031 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-18T01:14:31.040 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-18T01:14:31.040 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-18T01:14:31.055 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-osd. 2026-02-18T01:14:31.063 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../40-ceph-osd_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:31.064 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-osd (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:31.208 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph. 2026-02-18T01:14:31.217 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../41-ceph_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:31.217 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:31.231 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-fuse. 2026-02-18T01:14:31.239 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../42-ceph-fuse_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:31.239 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-fuse (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:31.260 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-mds. 2026-02-18T01:14:31.269 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../43-ceph-mds_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:31.269 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-mds (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:31.301 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package cephadm. 2026-02-18T01:14:31.309 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../44-cephadm_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:31.309 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking cephadm (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:31.325 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-18T01:14:31.333 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../45-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-18T01:14:31.334 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-18T01:14:31.354 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-18T01:14:31.363 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../46-ceph-mgr-cephadm_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T01:14:31.363 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-mgr-cephadm (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:31.385 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-18T01:14:31.393 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../47-python3-repoze.lru_0.7-2_all.deb ... 2026-02-18T01:14:31.393 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-18T01:14:31.407 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-routes. 2026-02-18T01:14:31.416 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../48-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-18T01:14:31.416 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-18T01:14:31.436 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-18T01:14:31.444 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../49-ceph-mgr-dashboard_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T01:14:31.445 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-mgr-dashboard (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:31.868 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-18T01:14:31.877 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../50-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-18T01:14:31.877 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-18T01:14:31.915 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-joblib. 2026-02-18T01:14:31.924 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../51-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-18T01:14:31.924 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-18T01:14:31.951 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-18T01:14:31.960 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../52-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-18T01:14:31.960 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-18T01:14:31.975 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-sklearn. 2026-02-18T01:14:31.984 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../53-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-18T01:14:31.984 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-18T01:14:32.066 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-18T01:14:32.075 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../54-ceph-mgr-diskprediction-local_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T01:14:32.076 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-mgr-diskprediction-local (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:32.242 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-cachetools. 2026-02-18T01:14:32.251 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../55-python3-cachetools_5.0.0-1_all.deb ... 2026-02-18T01:14:32.251 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-18T01:14:32.266 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-rsa. 2026-02-18T01:14:32.274 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../56-python3-rsa_4.8-1_all.deb ... 2026-02-18T01:14:32.274 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-18T01:14:32.292 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-google-auth. 2026-02-18T01:14:32.301 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../57-python3-google-auth_1.5.1-3_all.deb ... 2026-02-18T01:14:32.302 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-18T01:14:32.319 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-18T01:14:32.327 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../58-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-18T01:14:32.328 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-18T01:14:32.343 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-websocket. 2026-02-18T01:14:32.352 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../59-python3-websocket_1.2.3-1_all.deb ... 2026-02-18T01:14:32.352 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-18T01:14:32.369 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-18T01:14:32.377 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../60-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-18T01:14:32.378 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-18T01:14:32.472 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-18T01:14:32.481 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../61-ceph-mgr-k8sevents_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T01:14:32.482 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-mgr-k8sevents (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:32.495 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-18T01:14:32.504 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../62-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-18T01:14:32.504 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-18T01:14:32.520 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-18T01:14:32.528 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../63-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-18T01:14:32.529 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-18T01:14:32.544 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package jq. 2026-02-18T01:14:32.552 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../64-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-18T01:14:32.552 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-18T01:14:32.567 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package socat. 2026-02-18T01:14:32.576 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../65-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-18T01:14:32.576 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-18T01:14:32.595 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package xmlstarlet. 2026-02-18T01:14:32.603 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../66-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-18T01:14:32.604 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-18T01:14:32.640 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-test. 2026-02-18T01:14:32.648 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../67-ceph-test_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:32.649 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-test (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:33.512 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package ceph-volume. 2026-02-18T01:14:33.521 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../68-ceph-volume_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T01:14:33.521 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking ceph-volume (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:33.544 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-18T01:14:33.553 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../69-libcephfs-daemon_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:33.553 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libcephfs-daemon (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:33.568 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-18T01:14:33.576 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../70-libcephfs-proxy2_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:33.577 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libcephfs-proxy2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:33.592 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-18T01:14:33.600 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../71-libcephfs-dev_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:33.601 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking libcephfs-dev (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:33.616 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package nvme-cli. 2026-02-18T01:14:33.624 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../72-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-18T01:14:33.625 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-18T01:14:33.658 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-18T01:14:33.667 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../73-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-18T01:14:33.667 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-18T01:14:33.696 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-18T01:14:33.705 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../74-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-18T01:14:33.705 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-18T01:14:33.720 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-pluggy. 2026-02-18T01:14:33.729 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../75-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-18T01:14:33.729 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-18T01:14:33.745 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-psutil. 2026-02-18T01:14:33.753 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../76-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-18T01:14:33.753 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-18T01:14:33.772 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-py. 2026-02-18T01:14:33.780 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../77-python3-py_1.10.0-1_all.deb ... 2026-02-18T01:14:33.781 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-18T01:14:33.802 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-pygments. 2026-02-18T01:14:33.810 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../78-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-18T01:14:33.810 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-18T01:14:33.852 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-toml. 2026-02-18T01:14:33.860 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../79-python3-toml_0.10.2-1_all.deb ... 2026-02-18T01:14:33.861 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-18T01:14:33.875 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-pytest. 2026-02-18T01:14:33.884 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../80-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-18T01:14:33.884 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-18T01:14:33.906 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-simplejson. 2026-02-18T01:14:33.914 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../81-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-18T01:14:33.915 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-18T01:14:33.933 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package python3-webob. 2026-02-18T01:14:33.941 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../82-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-18T01:14:33.941 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-18T01:14:33.964 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-18T01:14:33.973 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../83-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-18T01:14:33.973 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-18T01:14:34.040 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package radosgw. 2026-02-18T01:14:34.048 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../84-radosgw_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:34.049 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking radosgw (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:34.260 INFO:teuthology.orchestra.run.trial080.stdout:Selecting previously unselected package rbd-fuse. 2026-02-18T01:14:34.269 INFO:teuthology.orchestra.run.trial080.stdout:Preparing to unpack .../85-rbd-fuse_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T01:14:34.269 INFO:teuthology.orchestra.run.trial080.stdout:Unpacking rbd-fuse (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:34.296 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-18T01:14:34.363 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-18T01:14:34.364 INFO:teuthology.orchestra.run.trial080.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-18T01:14:34.434 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T01:14:34.703 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-18T01:14:35.073 INFO:teuthology.orchestra.run.trial080.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-18T01:14:35.084 INFO:teuthology.orchestra.run.trial080.stdout:Setting up cephadm (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:35.127 INFO:teuthology.orchestra.run.trial080.stdout:Adding system user cephadm....done 2026-02-18T01:14:35.138 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-18T01:14:35.211 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-18T01:14:35.212 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-18T01:14:35.284 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-18T01:14:35.358 INFO:teuthology.orchestra.run.trial080.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-18T01:14:35.359 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-18T01:14:35.454 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-18T01:14:35.577 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-18T01:14:35.654 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-18T01:14:35.729 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-ceph-argparse (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:35.798 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-18T01:14:35.799 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-18T01:14:35.800 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-18T01:14:35.800 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-18T01:14:35.801 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-18T01:14:35.924 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-18T01:14:36.001 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libcephfs-proxy2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:36.002 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-18T01:14:36.081 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-18T01:14:36.171 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-18T01:14:36.416 INFO:teuthology.orchestra.run.trial080.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-18T01:14:36.416 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-18T01:14:36.511 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-18T01:14:36.636 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-18T01:14:36.716 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-18T01:14:36.788 INFO:teuthology.orchestra.run.trial080.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-18T01:14:36.789 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-ceph-common (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:36.877 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-18T01:14:37.372 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-18T01:14:37.377 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-18T01:14:37.452 INFO:teuthology.orchestra.run.trial080.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-18T01:14:37.453 INFO:teuthology.orchestra.run.trial080.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-18T01:14:37.454 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-18T01:14:37.530 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-18T01:14:37.603 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-18T01:14:37.604 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-18T01:14:37.685 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-18T01:14:37.757 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-18T01:14:37.837 INFO:teuthology.orchestra.run.trial080.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-18T01:14:37.838 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-18T01:14:37.921 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-18T01:14:37.922 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-18T01:14:38.000 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-18T01:14:38.085 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-18T01:14:38.161 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-18T01:14:38.162 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-18T01:14:38.295 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-18T01:14:38.368 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-18T01:14:38.369 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-18T01:14:38.449 INFO:teuthology.orchestra.run.trial080.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-18T01:14:38.450 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-18T01:14:38.582 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-18T01:14:38.583 INFO:teuthology.orchestra.run.trial080.stdout:Setting up librados2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:38.584 INFO:teuthology.orchestra.run.trial080.stdout:Setting up librgw2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:38.585 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libsqlite3-mod-ceph (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:38.586 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-18T01:14:39.103 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libcephfs2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.104 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libradosstriper1 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.105 INFO:teuthology.orchestra.run.trial080.stdout:Setting up librbd1 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.106 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-mgr-modules-core (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.107 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-fuse (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.183 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-18T01:14:39.183 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-18T01:14:39.557 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libcephfs-dev (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.558 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-rados (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.559 INFO:teuthology.orchestra.run.trial080.stdout:Setting up libcephfs-daemon (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.560 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-rbd (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.561 INFO:teuthology.orchestra.run.trial080.stdout:Setting up rbd-fuse (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.561 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-rgw (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.562 INFO:teuthology.orchestra.run.trial080.stdout:Setting up python3-cephfs (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.563 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-common (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:39.592 INFO:teuthology.orchestra.run.trial080.stdout:Adding group ceph....done 2026-02-18T01:14:39.627 INFO:teuthology.orchestra.run.trial080.stdout:Adding system user ceph....done 2026-02-18T01:14:39.637 INFO:teuthology.orchestra.run.trial080.stdout:Setting system user ceph properties....done 2026-02-18T01:14:39.644 INFO:teuthology.orchestra.run.trial080.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-18T01:14:39.733 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-18T01:14:40.005 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-18T01:14:40.374 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-test (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:40.375 INFO:teuthology.orchestra.run.trial080.stdout:Setting up radosgw (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:40.627 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-18T01:14:40.627 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-18T01:14:40.973 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-base (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:41.093 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-18T01:14:41.450 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-mds (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:41.509 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-18T01:14:41.510 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-18T01:14:41.849 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-mgr (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:41.927 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-18T01:14:41.927 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-18T01:14:42.278 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-osd (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:42.363 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-18T01:14:42.364 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-18T01:14:42.721 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-mgr-k8sevents (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:42.730 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-mgr-diskprediction-local (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:42.740 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-mon (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:42.809 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-18T01:14:42.809 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-18T01:14:43.165 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-mgr-cephadm (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:43.175 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:43.176 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-mgr-dashboard (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:43.187 INFO:teuthology.orchestra.run.trial080.stdout:Setting up ceph-volume (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T01:14:43.297 INFO:teuthology.orchestra.run.trial080.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-18T01:14:43.382 INFO:teuthology.orchestra.run.trial080.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-18T01:14:44.017 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:14:44.017 INFO:teuthology.orchestra.run.trial080.stdout:Running kernel seems to be up-to-date. 2026-02-18T01:14:44.017 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:14:44.017 INFO:teuthology.orchestra.run.trial080.stdout:The processor microcode seems to be up-to-date. 2026-02-18T01:14:44.017 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:14:44.017 INFO:teuthology.orchestra.run.trial080.stdout:No services need to be restarted. 2026-02-18T01:14:44.018 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:14:44.018 INFO:teuthology.orchestra.run.trial080.stdout:No containers need to be restarted. 2026-02-18T01:14:44.018 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:14:44.018 INFO:teuthology.orchestra.run.trial080.stdout:No user sessions are running outdated binaries. 2026-02-18T01:14:44.018 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-18T01:14:44.018 INFO:teuthology.orchestra.run.trial080.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-18T01:14:44.657 INFO:teuthology.orchestra.run.trial080.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-18T01:14:44.664 DEBUG:teuthology.parallel:result is None 2026-02-18T01:14:44.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T01:14:44.828 DEBUG:teuthology.orchestra.run.trial080:> dpkg-query -W -f '${Version}' ceph 2026-02-18T01:14:44.838 INFO:teuthology.orchestra.run.trial080.stdout:20.2.0-670-gadc19233-1jammy 2026-02-18T01:14:44.838 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670-gadc19233-1jammy 2026-02-18T01:14:44.839 INFO:teuthology.task.install:The correct ceph version 20.2.0-670-gadc19233-1jammy is installed. 2026-02-18T01:14:44.841 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-18T01:14:44.841 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-18T01:14:44.841 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T01:14:44.888 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-18T01:14:44.888 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-18T01:14:44.889 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T01:14:44.940 DEBUG:teuthology.orchestra.run.trial080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T01:14:44.990 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-18T01:14:44.991 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-18T01:14:44.991 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T01:14:45.040 DEBUG:teuthology.orchestra.run.trial080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T01:14:45.090 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-18T01:14:45.091 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-18T01:14:45.091 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T01:14:45.140 DEBUG:teuthology.orchestra.run.trial080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T01:14:45.190 INFO:teuthology.run_tasks:Running task workunit... 2026-02-18T01:14:45.205 INFO:tasks.workunit:Pulling workunits from ref adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T01:14:45.205 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-18T01:14:45.205 INFO:tasks.workunit:timeout=3h 2026-02-18T01:14:45.205 INFO:tasks.workunit:cleanup=True 2026-02-18T01:14:45.205 DEBUG:teuthology.orchestra.run.trial080:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-18T01:14:45.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T01:14:45.234 INFO:teuthology.orchestra.run.trial080.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-18T01:14:45.234 DEBUG:teuthology.orchestra.run.trial080:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T01:14:45.278 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-18T01:14:45.278 DEBUG:teuthology.orchestra.run.trial080:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-18T01:14:45.321 DEBUG:teuthology.orchestra.run.trial080:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T01:14:45.372 INFO:tasks.workunit.client.0.trial080.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-18T01:15:07.001 INFO:tasks.workunit.client.0.trial080.stderr:Note: switching to 'adc1923395f2bcd6ae89b5d331d278364d1848ed'. 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr: 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr:state without impacting any branches by switching back to a branch. 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr: 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr: 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr: git switch -c 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr: 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr:Or undo this operation with: 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr: 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr: git switch - 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr: 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr: 2026-02-18T01:15:07.002 INFO:tasks.workunit.client.0.trial080.stderr:HEAD is now at adc1923395f Merge PR #67279 into tentacle 2026-02-18T01:15:07.011 DEBUG:teuthology.orchestra.run.trial080:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-18T01:15:07.061 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-18T01:15:07.061 DEBUG:teuthology.orchestra.run.trial080:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-18T01:15:07.108 INFO:tasks.workunit:Running workunits matching osd on client.0... 2026-02-18T01:15:07.109 INFO:tasks.workunit:Running workunit osd/bad-inc-map.sh... 2026-02-18T01:15:07.109 DEBUG:teuthology.orchestra.run.trial080:workunit test osd/bad-inc-map.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2026-02-18T01:15:07.161 INFO:tasks.workunit.client.0.trial080.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T01:15:07.178 INFO:tasks.workunit.client.0.trial080.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T01:15:07.178 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T01:15:07.178 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T01:15:07.178 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T01:15:07.178 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T01:15:07.178 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T01:15:07.178 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T01:15:07.178 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T01:15:07.178 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T01:15:07.179 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/bad-inc-map 2026-02-18T01:15:07.179 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:8: run: local dir=td/bad-inc-map 2026-02-18T01:15:07.179 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:9: run: shift 2026-02-18T01:15:07.179 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: export CEPH_MON=127.0.0.1:49227 2026-02-18T01:15:07.179 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: CEPH_MON=127.0.0.1:49227 2026-02-18T01:15:07.179 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:12: run: export CEPH_ARGS 2026-02-18T01:15:07.179 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: uuidgen 2026-02-18T01:15:07.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: CEPH_ARGS+='--fsid=87ac524f-0ef1-43da-b19c-b131bfe09939 --auth-supported=none ' 2026-02-18T01:15:07.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:49227 ' 2026-02-18T01:15:07.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:15: run: set -e 2026-02-18T01:15:07.180 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: set 2026-02-18T01:15:07.180 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T01:15:07.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: local funcs=TEST_bad_inc_map 2026-02-18T01:15:07.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:18: run: for func in $funcs 2026-02-18T01:15:07.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:19: run: setup td/bad-inc-map 2026-02-18T01:15:07.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/bad-inc-map 2026-02-18T01:15:07.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/bad-inc-map 2026-02-18T01:15:07.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-18T01:15:07.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:15:07.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-18T01:15:07.183 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:15:07.183 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:15:07.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:15:07.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:15:07.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:15:07.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:15:07.184 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:15:07.184 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:15:07.185 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:15:07.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:15:07.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:15:07.186 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:15:07.187 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:15:07.187 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:15:07.188 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:15:07.188 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:15:07.188 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:15:07.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:15:07.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-18T01:15:07.191 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:15:07.192 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:07.192 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7519 2026-02-18T01:15:07.192 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7519 2026-02-18T01:15:07.193 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:15:07.193 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:15:07.193 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/bad-inc-map 2026-02-18T01:15:07.195 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:15:07.195 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:07.195 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7519 2026-02-18T01:15:07.195 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7519 2026-02-18T01:15:07.196 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:15:07.198 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T01:15:07.198 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T01:15:07.198 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:15:07.198 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/bad-inc-map 1' TERM HUP INT 2026-02-18T01:15:07.198 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:20: run: TEST_bad_inc_map td/bad-inc-map 2026-02-18T01:15:07.198 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:26: TEST_bad_inc_map: local dir=td/bad-inc-map 2026-02-18T01:15:07.198 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:28: TEST_bad_inc_map: run_mon td/bad-inc-map a 2026-02-18T01:15:07.198 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/bad-inc-map 2026-02-18T01:15:07.198 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:15:07.199 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:15:07.199 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:15:07.199 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/bad-inc-map/a 2026-02-18T01:15:07.199 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/bad-inc-map/a --run-dir=td/bad-inc-map 2026-02-18T01:15:07.231 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:15:07.231 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:15:07.231 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:15:07.231 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:15:07.232 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:07.232 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7519 2026-02-18T01:15:07.232 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7519/$cluster-$name.asok' 2026-02-18T01:15:07.232 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/bad-inc-map/a '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.7519/$cluster-$name.asok' --mon-cluster-log-file=td/bad-inc-map/log --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T01:15:07.258 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:15:07.259 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:15:07.259 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:15:07.259 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:15:07.259 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:15:07.261 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:15:07.261 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:15:07.261 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:15:07.261 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:15:07.261 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:15:07.261 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:07.261 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7519 2026-02-18T01:15:07.261 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7519/ceph-mon.a.asok 2026-02-18T01:15:07.261 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:15:07.261 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7519/ceph-mon.a.asok config get fsid 2026-02-18T01:15:07.315 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:15:07.315 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:15:07.315 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:15:07.315 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:15:07.315 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:15:07.317 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:15:07.317 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:15:07.317 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:15:07.317 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:15:07.317 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:07.317 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7519 2026-02-18T01:15:07.317 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7519/ceph-mon.a.asok 2026-02-18T01:15:07.317 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:15:07.317 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7519/ceph-mon.a.asok config get mon_host 2026-02-18T01:15:07.370 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:29: TEST_bad_inc_map: run_mgr td/bad-inc-map x 2026-02-18T01:15:07.370 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/bad-inc-map 2026-02-18T01:15:07.370 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:15:07.370 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T01:15:07.370 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:15:07.370 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/bad-inc-map/x 2026-02-18T01:15:07.370 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:15:07.479 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:15:07.479 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:15:07.479 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:15:07.479 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:15:07.479 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:07.479 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7519 2026-02-18T01:15:07.480 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7519/$cluster-$name.asok' 2026-02-18T01:15:07.480 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:15:07.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/bad-inc-map/x '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.7519/$cluster-$name.asok' --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:15:07.501 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:30: TEST_bad_inc_map: run_osd td/bad-inc-map 0 2026-02-18T01:15:07.501 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-18T01:15:07.502 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:15:07.502 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:15:07.502 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:15:07.502 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/0 2026-02-18T01:15:07.502 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=87ac524f-0ef1-43da-b19c-b131bfe09939 --auth-supported=none --mon-host=127.0.0.1:49227 ' 2026-02-18T01:15:07.502 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:15:07.502 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:15:07.502 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:15:07.502 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/0' 2026-02-18T01:15:07.502 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/0/journal' 2026-02-18T01:15:07.502 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7519 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7519/$cluster-$name.asok' 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7519/$cluster-$name.asok' 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:15:07.503 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:15:07.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-18T01:15:07.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-18T01:15:07.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:15:07.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:15:07.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:15:07.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:15:07.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:15:07.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:15:07.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/0 2026-02-18T01:15:07.505 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:15:07.505 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2917a383-2cc4-4670-956a-f4639cc4f336 2026-02-18T01:15:07.505 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2917a383-2cc4-4670-956a-f4639cc4f336' 2026-02-18T01:15:07.505 INFO:tasks.workunit.client.0.trial080.stdout:add osd0 2917a383-2cc4-4670-956a-f4639cc4f336 2026-02-18T01:15:07.506 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:15:07.513 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCbEpVpRFd4HhAAtM7EWxgVN2K3Au/MjUdVYQ== 2026-02-18T01:15:07.513 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCbEpVpRFd4HhAAtM7EWxgVN2K3Au/MjUdVYQ=="}' 2026-02-18T01:15:07.513 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2917a383-2cc4-4670-956a-f4639cc4f336 -i td/bad-inc-map/0/new.json 2026-02-18T01:15:07.633 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:15:07.641 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/0/new.json 2026-02-18T01:15:07.642 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=87ac524f-0ef1-43da-b19c-b131bfe09939 --auth-supported=none --mon-host=127.0.0.1:49227 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7519/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCbEpVpRFd4HhAAtM7EWxgVN2K3Au/MjUdVYQ== --osd-uuid 2917a383-2cc4-4670-956a-f4639cc4f336 2026-02-18T01:15:07.657 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:07.652+0000 7f7948797a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:07.659 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:07.652+0000 7f7948797a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:07.660 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:07.656+0000 7f7948797a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:07.660 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:07.656+0000 7f7948797a40 -1 bdev(0x558b78200c00 td/bad-inc-map/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:15:07.660 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:07.656+0000 7f7948797a40 -1 bluestore(td/bad-inc-map/0) _read_fsid unparsable uuid 2026-02-18T01:15:08.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/0/keyring 2026-02-18T01:15:08.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:15:08.382 INFO:tasks.workunit.client.0.trial080.stdout:adding osd0 key to auth repository 2026-02-18T01:15:08.383 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:15:08.383 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:15:08.493 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:15:08.494 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:15:08.494 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=87ac524f-0ef1-43da-b19c-b131bfe09939 --auth-supported=none --mon-host=127.0.0.1:49227 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7519/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:15:08.495 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:15:08.495 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:15:08.495 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:15:08.508 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:08.504+0000 7f67a5f76a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:08.509 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:08.504+0000 7f67a5f76a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:08.510 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:08.504+0000 7f67a5f76a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:08.602 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:15:08.602 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:15:08.602 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:15:08.602 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:15:08.603 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:15:08.603 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:08.603 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:15:08.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:15:08.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:08.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:15:08.708 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:15:08.909 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:08.904+0000 7f67a5f76a40 -1 Falling back to public interface 2026-02-18T01:15:09.578 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:09.572+0000 7f67a5f76a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:15:09.709 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:15:09.709 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:09.710 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:15:09.710 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:15:09.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:09.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:15:09.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:15:10.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:15:10.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:10.818 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:15:10.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:15:10.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:10.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:15:11.027 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1446297627,v1:127.0.0.1:6801/1446297627] [v2:127.0.0.1:6802/1446297627,v1:127.0.0.1:6803/1446297627] exists,up 2917a383-2cc4-4670-956a-f4639cc4f336 2026-02-18T01:15:11.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:15:11.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:15:11.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:15:11.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:31: TEST_bad_inc_map: run_osd td/bad-inc-map 1 2026-02-18T01:15:11.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-18T01:15:11.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:15:11.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T01:15:11.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:15:11.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/1 2026-02-18T01:15:11.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=87ac524f-0ef1-43da-b19c-b131bfe09939 --auth-supported=none --mon-host=127.0.0.1:49227 ' 2026-02-18T01:15:11.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:15:11.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:15:11.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:15:11.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/1' 2026-02-18T01:15:11.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/1/journal' 2026-02-18T01:15:11.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:15:11.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:15:11.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-18T01:15:11.032 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:15:11.032 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:15:11.032 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:15:11.032 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:15:11.032 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:11.032 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7519 2026-02-18T01:15:11.032 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7519/$cluster-$name.asok' 2026-02-18T01:15:11.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7519/$cluster-$name.asok' 2026-02-18T01:15:11.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:15:11.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:15:11.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:15:11.033 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-18T01:15:11.033 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-18T01:15:11.033 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:15:11.033 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:15:11.033 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:15:11.033 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:15:11.033 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:15:11.033 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:15:11.033 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/1 2026-02-18T01:15:11.033 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:15:11.034 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5ac5f6eb-2412-4514-8c36-78c411c2649c 2026-02-18T01:15:11.034 INFO:tasks.workunit.client.0.trial080.stdout:add osd1 5ac5f6eb-2412-4514-8c36-78c411c2649c 2026-02-18T01:15:11.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 5ac5f6eb-2412-4514-8c36-78c411c2649c' 2026-02-18T01:15:11.035 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:15:11.043 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCfEpVpzO90AhAAiSG7RpjyZeSrq+a4Qu8A9w== 2026-02-18T01:15:11.043 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCfEpVpzO90AhAAiSG7RpjyZeSrq+a4Qu8A9w=="}' 2026-02-18T01:15:11.043 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5ac5f6eb-2412-4514-8c36-78c411c2649c -i td/bad-inc-map/1/new.json 2026-02-18T01:15:11.272 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:15:11.281 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/1/new.json 2026-02-18T01:15:11.282 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=87ac524f-0ef1-43da-b19c-b131bfe09939 --auth-supported=none --mon-host=127.0.0.1:49227 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7519/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCfEpVpzO90AhAAiSG7RpjyZeSrq+a4Qu8A9w== --osd-uuid 5ac5f6eb-2412-4514-8c36-78c411c2649c 2026-02-18T01:15:11.297 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:11.292+0000 7f8d22b51a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:11.299 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:11.292+0000 7f8d22b51a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:11.300 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:11.296+0000 7f8d22b51a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:11.300 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:11.296+0000 7f8d22b51a40 -1 bdev(0x55b74dd3cc00 td/bad-inc-map/1/block) open stat got: (1) Operation not permitted 2026-02-18T01:15:11.300 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:11.296+0000 7f8d22b51a40 -1 bluestore(td/bad-inc-map/1) _read_fsid unparsable uuid 2026-02-18T01:15:11.934 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/1/keyring 2026-02-18T01:15:11.935 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:15:11.935 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T01:15:11.936 INFO:tasks.workunit.client.0.trial080.stdout:adding osd1 key to auth repository 2026-02-18T01:15:11.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:15:12.233 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T01:15:12.234 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:15:12.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=87ac524f-0ef1-43da-b19c-b131bfe09939 --auth-supported=none --mon-host=127.0.0.1:49227 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7519/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:15:12.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:15:12.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:15:12.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:15:12.255 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:12.247+0000 7f92ae5d9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:12.256 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:12.251+0000 7f92ae5d9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:12.258 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:12.251+0000 7f92ae5d9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:12.449 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T01:15:12.449 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:15:12.450 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:15:12.450 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:15:12.450 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:15:12.450 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:12.450 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:15:12.451 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:15:12.451 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:12.451 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:15:12.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:15:12.677 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:12.671+0000 7f92ae5d9a40 -1 Falling back to public interface 2026-02-18T01:15:13.255 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:13.247+0000 7f92ae5d9a40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:15:13.660 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:15:13.660 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:13.660 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:15:13.661 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:15:13.661 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:13.661 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:15:13.872 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1543144775,v1:127.0.0.1:6811/1543144775] [v2:127.0.0.1:6812/1543144775,v1:127.0.0.1:6813/1543144775] exists,up 5ac5f6eb-2412-4514-8c36-78c411c2649c 2026-02-18T01:15:13.873 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:15:13.873 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:15:13.873 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:15:13.873 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:32: TEST_bad_inc_map: run_osd td/bad-inc-map 2 2026-02-18T01:15:13.873 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-18T01:15:13.873 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:15:13.873 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/2 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=87ac524f-0ef1-43da-b19c-b131bfe09939 --auth-supported=none --mon-host=127.0.0.1:49227 ' 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/2' 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/2/journal' 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:13.874 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7519 2026-02-18T01:15:13.875 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7519/$cluster-$name.asok' 2026-02-18T01:15:13.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7519/$cluster-$name.asok' 2026-02-18T01:15:13.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:15:13.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:15:13.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:15:13.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-18T01:15:13.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-18T01:15:13.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:15:13.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:15:13.876 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:15:13.876 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:15:13.876 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:15:13.876 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:15:13.876 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/2 2026-02-18T01:15:13.876 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:15:13.876 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d87c6d50-5bb9-49cf-8be4-62e16ee055e6 2026-02-18T01:15:13.876 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 d87c6d50-5bb9-49cf-8be4-62e16ee055e6' 2026-02-18T01:15:13.876 INFO:tasks.workunit.client.0.trial080.stdout:add osd2 d87c6d50-5bb9-49cf-8be4-62e16ee055e6 2026-02-18T01:15:13.877 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:15:13.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQChEpVpcxzgNBAA7TkFQNXxJD0glav6k8LfSQ== 2026-02-18T01:15:13.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQChEpVpcxzgNBAA7TkFQNXxJD0glav6k8LfSQ=="}' 2026-02-18T01:15:13.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d87c6d50-5bb9-49cf-8be4-62e16ee055e6 -i td/bad-inc-map/2/new.json 2026-02-18T01:15:14.112 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:15:14.121 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/2/new.json 2026-02-18T01:15:14.122 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=87ac524f-0ef1-43da-b19c-b131bfe09939 --auth-supported=none --mon-host=127.0.0.1:49227 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7519/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQChEpVpcxzgNBAA7TkFQNXxJD0glav6k8LfSQ== --osd-uuid d87c6d50-5bb9-49cf-8be4-62e16ee055e6 2026-02-18T01:15:14.137 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:14.131+0000 7f059bb35a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:14.138 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:14.131+0000 7f059bb35a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:14.139 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:14.131+0000 7f059bb35a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:14.140 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:14.135+0000 7f059bb35a40 -1 bdev(0x561e6df40c00 td/bad-inc-map/2/block) open stat got: (1) Operation not permitted 2026-02-18T01:15:14.140 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:14.135+0000 7f059bb35a40 -1 bluestore(td/bad-inc-map/2) _read_fsid unparsable uuid 2026-02-18T01:15:14.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/2/keyring 2026-02-18T01:15:14.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:15:14.799 INFO:tasks.workunit.client.0.trial080.stdout:adding osd2 key to auth repository 2026-02-18T01:15:14.799 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T01:15:14.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:15:15.085 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:15:15.087 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T01:15:15.087 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=87ac524f-0ef1-43da-b19c-b131bfe09939 --auth-supported=none --mon-host=127.0.0.1:49227 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7519/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:15:15.087 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:15:15.087 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:15:15.087 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:15:15.098 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:15.091+0000 7f1b51e64a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:15.099 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:15.091+0000 7f1b51e64a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:15.100 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:15.095+0000 7f1b51e64a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:15.296 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T01:15:15.296 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:15:15.296 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:15:15.296 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:15:15.296 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:15:15.296 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:15.297 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:15:15.297 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:15:15.297 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:15.298 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:15:15.469 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:15.463+0000 7f1b51e64a40 -1 Falling back to public interface 2026-02-18T01:15:15.509 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:15:16.062 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:16.055+0000 7f1b51e64a40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:15:16.510 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:15:16.511 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:16.511 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:15:16.511 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:15:16.512 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:16.512 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:15:16.723 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:15:17.725 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:15:17.725 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:17.725 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:15:17.726 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:15:17.726 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:17.726 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:15:17.931 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4135925925,v1:127.0.0.1:6819/4135925925] [v2:127.0.0.1:6820/4135925925,v1:127.0.0.1:6821/4135925925] exists,up d87c6d50-5bb9-49cf-8be4-62e16ee055e6 2026-02-18T01:15:17.932 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:15:17.932 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:15:17.932 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:15:17.932 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:34: TEST_bad_inc_map: ceph config set osd.2 osd_inject_bad_map_crc_probability 1 2026-02-18T01:15:18.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:37: TEST_bad_inc_map: create_pool foo 8 2026-02-18T01:15:18.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 8 2026-02-18T01:15:18.413 INFO:tasks.workunit.client.0.trial080.stderr:pool 'foo' already exists 2026-02-18T01:15:18.424 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T01:15:19.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:38: TEST_bad_inc_map: ceph osd pool set foo min_size 1 2026-02-18T01:15:19.728 INFO:tasks.workunit.client.0.trial080.stderr:set pool 1 min_size to 1 2026-02-18T01:15:19.740 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:39: TEST_bad_inc_map: ceph osd pool set foo min_size 2 2026-02-18T01:15:20.033 INFO:tasks.workunit.client.0.trial080.stderr:set pool 1 min_size to 2 2026-02-18T01:15:20.044 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:41: TEST_bad_inc_map: sleep 5 2026-02-18T01:15:25.046 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: TIMEOUT=10 2026-02-18T01:15:25.047 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: wait_for_osd up 0 2026-02-18T01:15:25.047 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:15:25.047 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:15:25.047 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:15:25.047 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:15:25.047 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-18T01:15:25.047 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:15:25.048 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:15:25.048 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:25.048 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:15:25.259 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 5 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1446297627,v1:127.0.0.1:6801/1446297627] [v2:127.0.0.1:6802/1446297627,v1:127.0.0.1:6803/1446297627] exists,up 2917a383-2cc4-4670-956a-f4639cc4f336 2026-02-18T01:15:25.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:15:25.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:15:25.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:15:25.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: TIMEOUT=10 2026-02-18T01:15:25.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: wait_for_osd up 1 2026-02-18T01:15:25.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:15:25.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:15:25.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:15:25.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:15:25.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-18T01:15:25.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:15:25.262 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:15:25.262 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:25.262 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:15:25.469 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 9 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1543144775,v1:127.0.0.1:6811/1543144775] [v2:127.0.0.1:6812/1543144775,v1:127.0.0.1:6813/1543144775] exists,up 5ac5f6eb-2412-4514-8c36-78c411c2649c 2026-02-18T01:15:25.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:15:25.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:15:25.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:15:25.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: TIMEOUT=10 2026-02-18T01:15:25.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: wait_for_osd up 2 2026-02-18T01:15:25.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:15:25.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:15:25.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:15:25.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:15:25.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-18T01:15:25.470 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:15:25.471 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:15:25.471 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:25.471 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:15:25.678 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 13 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4135925925,v1:127.0.0.1:6819/4135925925] [v2:127.0.0.1:6820/4135925925,v1:127.0.0.1:6821/4135925925] exists,up d87c6d50-5bb9-49cf-8be4-62e16ee055e6 2026-02-18T01:15:25.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:15:25.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:15:25.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:15:25.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:49: TEST_bad_inc_map: grep 'injecting map crc failure' td/bad-inc-map/osd.2.log 2026-02-18T01:15:25.680 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:18.359+0000 7f1b3ec9c640 -1 osd.2 13 handle_osd_map injecting map crc failure 2026-02-18T01:15:25.680 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:18.459+0000 7f1b40ca0640 -1 osd.2 14 handle_osd_map injecting map crc failure 2026-02-18T01:15:25.680 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:18.459+0000 7f1b40ca0640 -1 osd.2 14 handle_osd_map injecting map crc failure 2026-02-18T01:15:25.680 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:19.619+0000 7f1b40ca0640 -1 osd.2 15 handle_osd_map injecting map crc failure 2026-02-18T01:15:25.681 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:19.723+0000 7f1b40ca0640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-18T01:15:25.681 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:19.723+0000 7f1b3ec9c640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-18T01:15:25.681 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:19.923+0000 7f1b40ca0640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-18T01:15:25.681 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:20.027+0000 7f1b40ca0640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-18T01:15:25.681 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:20.027+0000 7f1b3ec9c640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-18T01:15:25.681 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:50: TEST_bad_inc_map: grep 'bailing because last' td/bad-inc-map/osd.2.log 2026-02-18T01:15:25.682 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:18.359+0000 7f1b3ec9c640 10 osd.2 13 handle_osd_map bailing because last < start (13<14) 2026-02-18T01:15:25.682 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:18.459+0000 7f1b40ca0640 10 osd.2 14 handle_osd_map bailing because last < start (14<15) 2026-02-18T01:15:25.682 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:18.459+0000 7f1b40ca0640 10 osd.2 14 handle_osd_map bailing because last < start (14<15) 2026-02-18T01:15:25.682 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:19.619+0000 7f1b40ca0640 10 osd.2 15 handle_osd_map bailing because last < start (15<16) 2026-02-18T01:15:25.682 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:19.723+0000 7f1b40ca0640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-18T01:15:25.682 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:19.723+0000 7f1b3ec9c640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-18T01:15:25.682 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:19.923+0000 7f1b40ca0640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-18T01:15:25.683 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:20.027+0000 7f1b40ca0640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-18T01:15:25.683 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:15:20.027+0000 7f1b3ec9c640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-18T01:15:25.683 INFO:tasks.workunit.client.0.trial080.stdout:success 2026-02-18T01:15:25.683 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:52: TEST_bad_inc_map: echo success 2026-02-18T01:15:25.683 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:54: TEST_bad_inc_map: delete_pool foo 2026-02-18T01:15:25.684 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=foo 2026-02-18T01:15:25.684 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2026-02-18T01:15:25.904 INFO:tasks.workunit.client.0.trial080.stderr:pool 'foo' does not exist 2026-02-18T01:15:25.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:55: TEST_bad_inc_map: kill_daemons td/bad-inc-map 2026-02-18T01:15:25.914 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:15:25.914 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:15:25.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:15:25.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:15:25.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:15:31.229 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:15:31.230 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:21: run: teardown td/bad-inc-map 2026-02-18T01:15:31.230 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-18T01:15:31.230 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:15:31.230 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-18T01:15:31.230 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:15:31.230 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:15:31.230 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:15:31.230 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:15:31.230 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:15:31.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:15:31.237 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:15:31.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:15:31.237 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:15:31.239 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:15:31.239 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:15:31.239 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:15:31.240 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:15:31.240 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:15:31.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:15:31.241 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:15:31.242 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:15:31.243 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:15:31.243 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-18T01:15:31.253 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:15:31.253 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:31.253 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7519 2026-02-18T01:15:31.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7519 2026-02-18T01:15:31.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:15:31.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:15:31.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T01:15:31.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/bad-inc-map 0 2026-02-18T01:15:31.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-18T01:15:31.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T01:15:31.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-18T01:15:31.256 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:15:31.256 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:15:31.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:15:31.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:15:31.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:15:31.258 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:15:31.258 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:15:31.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:15:31.259 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:15:31.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:15:31.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:15:31.261 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:15:31.262 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:15:31.262 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:15:31.262 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:15:31.263 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:15:31.264 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:15:31.265 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T01:15:31.265 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-18T01:15:31.266 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:15:31.266 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:31.266 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7519 2026-02-18T01:15:31.266 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7519 2026-02-18T01:15:31.267 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:15:31.267 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:15:31.267 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T01:15:31.269 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T01:15:31.269 DEBUG:teuthology.orchestra.run.trial080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T01:15:31.324 INFO:tasks.workunit:Running workunit osd/divergent-priors.sh... 2026-02-18T01:15:31.324 DEBUG:teuthology.orchestra.run.trial080:workunit test osd/divergent-priors.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2026-02-18T01:15:31.377 INFO:tasks.workunit.client.0.trial080.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T01:15:31.383 INFO:tasks.workunit.client.0.trial080.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T01:15:31.383 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T01:15:31.383 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T01:15:31.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T01:15:31.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T01:15:31.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T01:15:31.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T01:15:31.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T01:15:31.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T01:15:31.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/divergent-priors 2026-02-18T01:15:31.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:21: run: local dir=td/divergent-priors 2026-02-18T01:15:31.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:22: run: shift 2026-02-18T01:15:31.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: export loglen=12 2026-02-18T01:15:31.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: loglen=12 2026-02-18T01:15:31.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: export divisor=3 2026-02-18T01:15:31.385 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: divisor=3 2026-02-18T01:15:31.385 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: expr 12 / 2 2026-02-18T01:15:31.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: export trim=6 2026-02-18T01:15:31.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: trim=6 2026-02-18T01:15:31.386 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: expr 6 / 3 2026-02-18T01:15:31.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: export DIVERGENT_WRITE=2 2026-02-18T01:15:31.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: DIVERGENT_WRITE=2 2026-02-18T01:15:31.386 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: expr 6 / 3 2026-02-18T01:15:31.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: export DIVERGENT_REMOVE=2 2026-02-18T01:15:31.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: DIVERGENT_REMOVE=2 2026-02-18T01:15:31.387 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: expr 6 / 3 2026-02-18T01:15:31.388 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: export DIVERGENT_CREATE=2 2026-02-18T01:15:31.389 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: DIVERGENT_CREATE=2 2026-02-18T01:15:31.389 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: export poolname=test 2026-02-18T01:15:31.389 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: poolname=test 2026-02-18T01:15:31.389 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: export testobjects=100 2026-02-18T01:15:31.389 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: testobjects=100 2026-02-18T01:15:31.389 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: export CEPH_MON=127.0.0.1:7115 2026-02-18T01:15:31.389 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: CEPH_MON=127.0.0.1:7115 2026-02-18T01:15:31.389 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:35: run: export CEPH_ARGS 2026-02-18T01:15:31.389 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: uuidgen 2026-02-18T01:15:31.390 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: CEPH_ARGS+='--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none ' 2026-02-18T01:15:31.390 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:37: run: CEPH_ARGS+='--mon-host=127.0.0.1:7115 ' 2026-02-18T01:15:31.390 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:39: run: CEPH_ARGS+='--osd_force_auth_primary_missing_objects=1000000 ' 2026-02-18T01:15:31.390 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:40: run: CEPH_ARGS+='--osd_debug_pg_log_writeout=true ' 2026-02-18T01:15:31.391 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:41: run: CEPH_ARGS+='--osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:15:31.391 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: set 2026-02-18T01:15:31.391 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T01:15:31.393 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: local 'funcs=TEST_divergent 2026-02-18T01:15:31.394 INFO:tasks.workunit.client.0.trial080.stderr:TEST_divergent_2 2026-02-18T01:15:31.394 INFO:tasks.workunit.client.0.trial080.stderr:TEST_divergent_3 2026-02-18T01:15:31.394 INFO:tasks.workunit.client.0.trial080.stderr:TEST_divergent_ec' 2026-02-18T01:15:31.394 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-18T01:15:31.394 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-18T01:15:31.394 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-18T01:15:31.394 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-18T01:15:31.394 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-18T01:15:31.394 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:15:31.394 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-18T01:15:31.394 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:15:31.394 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:15:31.395 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:15:31.395 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:15:31.395 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:15:31.395 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:15:31.396 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:15:31.397 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:15:31.397 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:15:31.398 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:15:31.398 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:15:31.398 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:15:31.399 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:15:31.399 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:15:31.400 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:15:31.400 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:15:31.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:15:31.402 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:15:31.402 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-18T01:15:31.404 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:15:31.404 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:31.404 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:31.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16037 2026-02-18T01:15:31.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:15:31.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:15:31.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-18T01:15:31.406 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:15:31.406 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:31.406 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:31.407 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16037 2026-02-18T01:15:31.408 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:15:31.409 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T01:15:31.409 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T01:15:31.409 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:15:31.409 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-18T01:15:31.409 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent td/divergent-priors 2026-02-18T01:15:31.409 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:57: TEST_divergent: local dir=td/divergent-priors 2026-02-18T01:15:31.409 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: file_with_random_data 2026-02-18T01:15:31.410 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=512 2026-02-18T01:15:31.410 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-18T01:15:31.410 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:31.410 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.ZarSjo5J6P bs=512 count=1 2026-02-18T01:15:31.411 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records in 2026-02-18T01:15:31.412 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records out 2026-02-18T01:15:31.412 INFO:tasks.workunit.client.0.trial080.stderr:512 bytes copied, 9.5377e-05 s, 5.4 MB/s 2026-02-18T01:15:31.412 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:31.412 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: local dummyfile=/tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:31.412 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:60: TEST_divergent: local num_osds=3 2026-02-18T01:15:31.413 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: expr 3 - 1 2026-02-18T01:15:31.413 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: seq 0 2 2026-02-18T01:15:31.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: local 'osds=0 2026-02-18T01:15:31.415 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:15:31.415 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:15:31.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:62: TEST_divergent: run_mon td/divergent-priors a 2026-02-18T01:15:31.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-18T01:15:31.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:15:31.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:15:31.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:15:31.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-18T01:15:31.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-18T01:15:31.443 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:15:31.443 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:15:31.443 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:15:31.443 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:15:31.443 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:31.443 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:31.443 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:15:31.444 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T01:15:31.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:15:31.476 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:15:31.476 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:15:31.477 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:15:31.477 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:15:31.477 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:15:31.478 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:15:31.478 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:15:31.478 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:15:31.478 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:15:31.478 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:31.478 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:31.478 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-mon.a.asok 2026-02-18T01:15:31.478 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:15:31.479 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16037/ceph-mon.a.asok config get fsid 2026-02-18T01:15:31.533 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:15:31.533 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:15:31.533 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:15:31.533 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:15:31.533 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:15:31.535 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:15:31.535 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:15:31.535 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:15:31.535 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:15:31.535 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:31.535 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:31.535 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-mon.a.asok 2026-02-18T01:15:31.535 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:15:31.535 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16037/ceph-mon.a.asok config get mon_host 2026-02-18T01:15:31.589 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:63: TEST_divergent: run_mgr td/divergent-priors x 2026-02-18T01:15:31.589 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-18T01:15:31.589 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:15:31.589 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T01:15:31.589 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:15:31.589 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-18T01:15:31.589 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:15:31.709 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:15:31.710 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:15:31.710 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:15:31.710 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:15:31.710 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:31.710 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:31.710 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:15:31.711 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:15:31.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:15:31.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-18T01:15:31.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 0 2026-02-18T01:15:31.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-18T01:15:31.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:15:31.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:15:31.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:15:31.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-18T01:15:31.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:15:31.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:15:31.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:15:31.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:15:31.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-18T01:15:31.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-18T01:15:31.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:15:31.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:15:31.734 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:15:31.734 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:15:31.734 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:15:31.734 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:15:31.734 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:15:31.734 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:31.734 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:31.734 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:15:31.734 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:15:31.734 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:15:31.734 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:15:31.734 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:15:31.735 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:15:31.735 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:15:31.735 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:15:31.735 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:15:31.735 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:15:31.735 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:15:31.735 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:15:31.735 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:15:31.735 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-18T01:15:31.735 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:15:31.736 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4de00105-d732-44db-9ff4-0950682771c4 2026-02-18T01:15:31.736 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 4de00105-d732-44db-9ff4-0950682771c4' 2026-02-18T01:15:31.736 INFO:tasks.workunit.client.0.trial080.stdout:add osd0 4de00105-d732-44db-9ff4-0950682771c4 2026-02-18T01:15:31.737 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:15:31.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCzEpVpufNgLBAA4x7enO7IZJaND0W4knacTw== 2026-02-18T01:15:31.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCzEpVpufNgLBAA4x7enO7IZJaND0W4knacTw=="}' 2026-02-18T01:15:31.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4de00105-d732-44db-9ff4-0950682771c4 -i td/divergent-priors/0/new.json 2026-02-18T01:15:31.861 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:15:31.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-18T01:15:31.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCzEpVpufNgLBAA4x7enO7IZJaND0W4knacTw== --osd-uuid 4de00105-d732-44db-9ff4-0950682771c4 2026-02-18T01:15:31.888 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:31.883+0000 7f90d9b91a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:31.890 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:31.883+0000 7f90d9b91a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:31.890 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:31.883+0000 7f90d9b91a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:31.891 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:31.883+0000 7f90d9b91a40 -1 bdev(0x558363564c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:15:31.891 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:31.883+0000 7f90d9b91a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-18T01:15:32.643 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-18T01:15:32.643 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:15:32.644 INFO:tasks.workunit.client.0.trial080.stdout:adding osd0 key to auth repository 2026-02-18T01:15:32.645 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:15:32.645 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:15:32.773 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:15:32.773 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:15:32.773 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:15:32.773 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:15:32.773 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:15:32.773 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:15:32.803 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:32.795+0000 7fa3a35ada40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:32.805 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:32.799+0000 7fa3a35ada40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:32.806 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:32.799+0000 7fa3a35ada40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:32.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:15:32.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:15:32.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:15:32.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:15:32.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:15:32.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:32.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:15:32.886 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:15:32.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:32.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:15:32.998 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:15:33.370 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:33.363+0000 7fa3a35ada40 -1 Falling back to public interface 2026-02-18T01:15:33.999 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:15:34.000 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:15:34.000 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:34.000 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:15:34.000 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:34.000 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:15:34.212 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:15:34.326 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:34.319+0000 7fa3a35ada40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:15:35.213 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:15:35.214 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:35.214 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:15:35.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:15:35.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:35.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:15:35.425 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2471457752,v1:127.0.0.1:6801/2471457752] [v2:127.0.0.1:6802/2471457752,v1:127.0.0.1:6803/2471457752] exists,up 4de00105-d732-44db-9ff4-0950682771c4 2026-02-18T01:15:35.428 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:15:35.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:15:35.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:15:35.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-18T01:15:35.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 1 2026-02-18T01:15:35.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-18T01:15:35.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:15:35.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T01:15:35.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:15:35.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-18T01:15:35.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:15:35.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:15:35.430 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:15:35.430 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:15:35.430 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-18T01:15:35.430 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-18T01:15:35.430 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:15:35.430 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:15:35.430 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:15:35.430 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:15:35.430 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:15:35.430 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:15:35.430 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:15:35.430 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:15:35.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:15:35.432 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:15:35.432 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-18T01:15:35.432 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:15:35.432 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=29c54dd7-a960-4aaf-b76a-6e4983f7a2cc 2026-02-18T01:15:35.432 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 29c54dd7-a960-4aaf-b76a-6e4983f7a2cc' 2026-02-18T01:15:35.433 INFO:tasks.workunit.client.0.trial080.stdout:add osd1 29c54dd7-a960-4aaf-b76a-6e4983f7a2cc 2026-02-18T01:15:35.433 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:15:35.444 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC3EpVpm8NVGhAAX2hQlcu55oVXjaH36pIH+A== 2026-02-18T01:15:35.444 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC3EpVpm8NVGhAAX2hQlcu55oVXjaH36pIH+A=="}' 2026-02-18T01:15:35.444 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 29c54dd7-a960-4aaf-b76a-6e4983f7a2cc -i td/divergent-priors/1/new.json 2026-02-18T01:15:35.667 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:15:35.676 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-18T01:15:35.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC3EpVpm8NVGhAAX2hQlcu55oVXjaH36pIH+A== --osd-uuid 29c54dd7-a960-4aaf-b76a-6e4983f7a2cc 2026-02-18T01:15:35.704 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:35.699+0000 7fef78f93a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:35.706 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:35.699+0000 7fef78f93a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:35.707 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:35.699+0000 7fef78f93a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:35.708 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:35.699+0000 7fef78f93a40 -1 bdev(0x563726e7ac00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-18T01:15:35.708 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:35.699+0000 7fef78f93a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-18T01:15:36.347 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-18T01:15:36.347 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:15:36.348 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T01:15:36.348 INFO:tasks.workunit.client.0.trial080.stdout:adding osd1 key to auth repository 2026-02-18T01:15:36.348 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:15:36.648 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:15:36.648 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T01:15:36.648 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:15:36.649 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:15:36.649 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:15:36.649 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:15:36.676 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:36.671+0000 7f10d0d51a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:36.678 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:36.671+0000 7f10d0d51a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:36.679 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:36.671+0000 7f10d0d51a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:36.879 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T01:15:36.880 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:15:36.880 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:15:36.880 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:15:36.880 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:15:36.880 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:36.880 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:15:36.880 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:15:36.880 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:36.880 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:15:37.074 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:37.067+0000 7f10d0d51a40 -1 Falling back to public interface 2026-02-18T01:15:37.095 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:15:37.696 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:37.687+0000 7f10d0d51a40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:15:38.096 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:15:38.096 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:38.097 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:15:38.097 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:15:38.097 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:38.098 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:15:38.312 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:15:39.313 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:15:39.313 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:39.314 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:15:39.314 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:15:39.314 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:39.315 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:15:39.530 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2540213220,v1:127.0.0.1:6811/2540213220] [v2:127.0.0.1:6812/2540213220,v1:127.0.0.1:6813/2540213220] exists,up 29c54dd7-a960-4aaf-b76a-6e4983f7a2cc 2026-02-18T01:15:39.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:15:39.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:15:39.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:15:39.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-18T01:15:39.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 2 2026-02-18T01:15:39.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-18T01:15:39.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:15:39.535 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:15:39.536 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:15:39.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:15:39.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:15:39.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:15:39.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:15:39.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:15:39.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-18T01:15:39.537 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:15:39.538 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5e478b18-d9ae-45fa-aeac-1283d483e8bb 2026-02-18T01:15:39.538 INFO:tasks.workunit.client.0.trial080.stdout:add osd2 5e478b18-d9ae-45fa-aeac-1283d483e8bb 2026-02-18T01:15:39.538 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 5e478b18-d9ae-45fa-aeac-1283d483e8bb' 2026-02-18T01:15:39.538 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:15:39.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC7EpVp0h2PIBAAHaz0Gnf2PXDJXYftzI2O+Q== 2026-02-18T01:15:39.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC7EpVp0h2PIBAAHaz0Gnf2PXDJXYftzI2O+Q=="}' 2026-02-18T01:15:39.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5e478b18-d9ae-45fa-aeac-1283d483e8bb -i td/divergent-priors/2/new.json 2026-02-18T01:15:39.765 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:15:39.774 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-18T01:15:39.775 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC7EpVp0h2PIBAAHaz0Gnf2PXDJXYftzI2O+Q== --osd-uuid 5e478b18-d9ae-45fa-aeac-1283d483e8bb 2026-02-18T01:15:39.794 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:39.787+0000 7f9202b55a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:39.795 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:39.787+0000 7f9202b55a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:39.797 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:39.791+0000 7f9202b55a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:39.797 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:39.791+0000 7f9202b55a40 -1 bdev(0x555acf584c00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-18T01:15:39.797 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:39.791+0000 7f9202b55a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-18T01:15:40.420 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-18T01:15:40.420 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:15:40.421 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T01:15:40.421 INFO:tasks.workunit.client.0.trial080.stdout:adding osd2 key to auth repository 2026-02-18T01:15:40.421 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:15:40.717 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:15:40.718 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T01:15:40.718 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:15:40.718 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:15:40.718 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:15:40.718 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:15:40.745 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:40.739+0000 7f9aa202ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:40.746 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:40.739+0000 7f9aa202ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:40.747 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:40.739+0000 7f9aa202ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:15:40.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T01:15:40.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:15:40.930 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:15:40.930 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:15:40.930 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:15:40.930 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:40.930 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:15:40.930 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:15:40.931 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:40.931 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:15:41.143 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:15:41.202 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:41.195+0000 7f9aa202ea40 -1 Falling back to public interface 2026-02-18T01:15:41.866 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:15:41.859+0000 7f9aa202ea40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:15:42.144 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:15:42.144 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:42.144 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:15:42.145 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:15:42.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:42.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:15:42.357 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:15:43.358 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:15:43.358 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:15:43.358 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:15:43.358 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:15:43.358 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:15:43.358 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:15:43.573 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1070688860,v1:127.0.0.1:6819/1070688860] [v2:127.0.0.1:6820/1070688860,v1:127.0.0.1:6821/1070688860] exists,up 5e478b18-d9ae-45fa-aeac-1283d483e8bb 2026-02-18T01:15:43.574 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:15:43.574 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:15:43.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:15:43.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: ceph osd set noout 2026-02-18T01:15:43.865 INFO:tasks.workunit.client.0.trial080.stderr:noout is set 2026-02-18T01:15:43.878 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:70: TEST_divergent: ceph osd set noin 2026-02-18T01:15:44.170 INFO:tasks.workunit.client.0.trial080.stderr:noin is set 2026-02-18T01:15:44.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:71: TEST_divergent: ceph osd set nodown 2026-02-18T01:15:44.475 INFO:tasks.workunit.client.0.trial080.stderr:nodown is set 2026-02-18T01:15:44.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:72: TEST_divergent: create_pool test 1 1 2026-02-18T01:15:44.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-18T01:15:44.729 INFO:tasks.workunit.client.0.trial080.stderr:pool 'test' already exists 2026-02-18T01:15:44.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T01:15:45.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:73: TEST_divergent: ceph osd pool set test size 3 2026-02-18T01:15:46.069 INFO:tasks.workunit.client.0.trial080.stderr:set pool 1 size to 3 2026-02-18T01:15:46.079 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:74: TEST_divergent: ceph osd pool set test min_size 2 2026-02-18T01:15:46.373 INFO:tasks.workunit.client.0.trial080.stderr:set pool 1 min_size to 2 2026-02-18T01:15:46.385 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:76: TEST_divergent: flush_pg_stats 2026-02-18T01:15:46.385 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:15:46.385 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:15:46.603 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:15:46.603 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:15:46.603 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:15:46.603 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:15:46.603 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:15:46.604 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:15:46.685 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-18T01:15:46.685 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-18T01:15:46.685 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485' 2026-02-18T01:15:46.685 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:15:46.686 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:15:46.767 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-18T01:15:46.767 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-18T01:15:46.767 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-18T01:15:46.767 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:15:46.768 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:15:46.845 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-18T01:15:46.845 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-18T01:15:46.845 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-55834574851' 2026-02-18T01:15:46.845 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:15:46.846 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-18T01:15:46.846 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:15:46.847 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:15:46.848 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836485 2026-02-18T01:15:46.848 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:15:46.849 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836485 2026-02-18T01:15:46.849 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-18T01:15:46.850 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836485 2026-02-18T01:15:46.850 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:15:47.064 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-18T01:15:47.065 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:15:48.066 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:15:48.066 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:15:48.282 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-18T01:15:48.282 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:15:48.283 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-18T01:15:48.283 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:15:48.284 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:15:48.285 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705668 2026-02-18T01:15:48.285 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:15:48.286 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705668 2026-02-18T01:15:48.287 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 38654705668 2026-02-18T01:15:48.287 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-18T01:15:48.287 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:15:48.515 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-18T01:15:48.515 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:15:48.516 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-18T01:15:48.516 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:15:48.517 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:15:48.518 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574851 2026-02-18T01:15:48.518 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:15:48.519 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574851 2026-02-18T01:15:48.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-18T01:15:48.520 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 55834574851 2026-02-18T01:15:48.520 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:15:48.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-18T01:15:48.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:77: TEST_divergent: wait_for_clean 2026-02-18T01:15:48.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:15:48.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:15:48.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:15:48.748 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:15:48.749 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:15:48.749 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:15:48.749 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:15:48.749 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:15:48.749 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:15:48.835 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:15:48.835 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:15:48.835 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:15:48.835 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:15:48.835 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:15:48.835 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:15:49.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:15:49.055 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:15:49.055 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:15:49.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:15:49.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:15:49.056 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:15:49.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-18T01:15:49.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-18T01:15:49.137 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-18T01:15:49.137 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:15:49.137 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:15:49.216 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705671 2026-02-18T01:15:49.216 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705671 2026-02-18T01:15:49.216 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705671' 2026-02-18T01:15:49.216 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:15:49.217 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:15:49.300 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-18T01:15:49.300 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-18T01:15:49.300 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705671 2-55834574854' 2026-02-18T01:15:49.300 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:15:49.301 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-18T01:15:49.301 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:15:49.301 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:15:49.302 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-18T01:15:49.302 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:15:49.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-18T01:15:49.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-18T01:15:49.304 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836487 2026-02-18T01:15:49.305 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:15:49.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-18T01:15:49.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:15:50.524 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:15:50.524 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:15:50.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-18T01:15:50.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:15:50.742 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705671 2026-02-18T01:15:50.742 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:15:50.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:15:50.744 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705671 2026-02-18T01:15:50.744 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:15:50.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705671 2026-02-18T01:15:50.746 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705671' 2026-02-18T01:15:50.746 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 38654705671 2026-02-18T01:15:50.746 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:15:50.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705671 -lt 38654705671 2026-02-18T01:15:50.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:15:50.960 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-18T01:15:50.960 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:15:50.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:15:50.962 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574854 2026-02-18T01:15:50.962 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:15:50.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574854 2026-02-18T01:15:50.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-18T01:15:50.964 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 55834574854 2026-02-18T01:15:50.964 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:15:51.187 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-18T01:15:51.188 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:15:51.188 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:15:51.189 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:15:51.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:15:51.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:15:51.471 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:15:51.471 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:15:51.471 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:15:51.471 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:15:51.471 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:15:51.471 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:15:51.684 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-18T01:15:51.685 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:15:51.685 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:15:51.685 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:15:51.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-18T01:15:51.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:15:51.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:15:51.964 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: ceph pg dump pgs --format=json 2026-02-18T01:15:51.965 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: jq '.pg_stats[0].up_primary' 2026-02-18T01:15:52.163 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:15:52.172 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: local divergent=1 2026-02-18T01:15:52.172 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:81: TEST_divergent: echo 'primary and soon to be divergent is 1' 2026-02-18T01:15:52.172 INFO:tasks.workunit.client.0.trial080.stdout:primary and soon to be divergent is 1 2026-02-18T01:15:52.173 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:82: TEST_divergent: ceph pg dump pgs 2026-02-18T01:15:52.377 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:15:52.377 INFO:tasks.workunit.client.0.trial080.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T01:15:44.883701+0000 0'0 26:22 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 periodic scrub scheduled @ 2026-02-19T07:58:44.559448+0000 0 0 2026-02-18T01:15:52.378 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:15:52.378 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:15:52.378 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:15:52.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: local non_divergent= 2026-02-18T01:15:52.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-18T01:15:52.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 0 = 1 ']' 2026-02-18T01:15:52.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0' 2026-02-18T01:15:52.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-18T01:15:52.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 1 = 1 ']' 2026-02-18T01:15:52.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: continue 2026-02-18T01:15:52.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-18T01:15:52.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 2 = 1 ']' 2026-02-18T01:15:52.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0 2' 2026-02-18T01:15:52.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: echo 'writing initial objects' 2026-02-18T01:15:52.387 INFO:tasks.workunit.client.0.trial080.stdout:writing initial objects 2026-02-18T01:15:52.387 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: seq 1 100 2026-02-18T01:15:52.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_1 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.410 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.410 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_2 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.438 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.438 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_3 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_4 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.494 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.494 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_5 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_6 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.550 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.550 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_7 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.578 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.578 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_8 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_9 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.634 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.634 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_10 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.662 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.662 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_11 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_12 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.718 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.718 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_13 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.740 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.740 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_14 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.759 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.760 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_15 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.790 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.790 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_16 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.815 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_17 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.842 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.843 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_18 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_19 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.896 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.896 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_20 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.923 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.924 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_21 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.943 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.943 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_22 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.971 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.971 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_23 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:52.998 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:52.998 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_24 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_25 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.054 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.054 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_26 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.082 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.082 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_27 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.101 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.101 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_28 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_29 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.156 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.156 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_30 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.184 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.185 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_31 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.205 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.206 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_32 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.232 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.232 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_33 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.258 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.258 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_34 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.286 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.286 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_35 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.314 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.314 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_36 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.341 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.342 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_37 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.370 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.370 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_38 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.397 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.398 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_39 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_40 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.454 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.454 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_41 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.481 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.482 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_42 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.509 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.509 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_43 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_44 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.565 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.566 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_45 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.593 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.594 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_46 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.621 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.621 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_47 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.649 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.649 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_48 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_49 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.705 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.705 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_50 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_51 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.761 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.761 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_52 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.789 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.789 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_53 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_54 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.844 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.844 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_55 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.872 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.872 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_56 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.901 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.901 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_57 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_58 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.957 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.957 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_59 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:53.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:53.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_60 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.005 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.005 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_61 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_62 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_63 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.089 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.089 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_64 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.117 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.117 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_65 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_66 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.174 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.174 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_67 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.202 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.202 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_68 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.230 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.230 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_69 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.250 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.250 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_70 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.270 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.270 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_71 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.298 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.298 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_72 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.326 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.326 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_73 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_74 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_75 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.409 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.409 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_76 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_77 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.465 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.465 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_78 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.494 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.494 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_79 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_80 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.550 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.550 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_81 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.578 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.578 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_82 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_83 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.634 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.634 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_84 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_85 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.681 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.681 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_86 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.702 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.702 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_87 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_88 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.754 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.755 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_89 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.782 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.782 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_90 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.810 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.810 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_91 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_92 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.866 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.866 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_93 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.894 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.894 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_94 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.921 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.922 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_95 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_96 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:54.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:54.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_97 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:55.006 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:55.006 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_98 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:55.034 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:55.034 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_99 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:55.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-18T01:15:55.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_100 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:55.090 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-18T01:15:55.090 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: wait_for_clean 2026-02-18T01:15:55.090 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:15:55.090 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:15:55.090 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:15:55.090 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-18T01:15:55.091 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:15:55.091 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:15:55.091 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:15:55.091 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:15:55.091 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:15:55.161 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-18T01:15:55.161 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:15:55.161 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:15:55.161 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:15:55.161 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:15:55.161 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:15:55.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:15:55.376 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:15:55.376 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:15:55.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:15:55.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:15:55.376 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:15:55.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-18T01:15:55.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-18T01:15:55.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490' 2026-02-18T01:15:55.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:15:55.460 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:15:55.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-18T01:15:55.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-18T01:15:55.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-38654705674' 2026-02-18T01:15:55.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:15:55.544 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:15:55.627 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-18T01:15:55.627 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-18T01:15:55.627 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-38654705674 2-55834574857' 2026-02-18T01:15:55.627 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:15:55.628 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-18T01:15:55.628 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:15:55.629 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:15:55.630 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836490 2026-02-18T01:15:55.630 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:15:55.631 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836490 2026-02-18T01:15:55.631 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-18T01:15:55.631 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836490 2026-02-18T01:15:55.632 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:15:55.857 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-18T01:15:55.857 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:15:56.858 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:15:56.859 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:15:57.071 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836490 2026-02-18T01:15:57.072 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:15:57.072 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-18T01:15:57.072 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:15:57.073 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:15:57.074 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705674 2026-02-18T01:15:57.074 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:15:57.076 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705674 2026-02-18T01:15:57.076 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-18T01:15:57.076 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 38654705674 2026-02-18T01:15:57.076 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:15:57.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-18T01:15:57.309 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:15:57.309 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-18T01:15:57.309 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:15:57.310 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:15:57.311 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574857 2026-02-18T01:15:57.311 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:15:57.313 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574857 2026-02-18T01:15:57.313 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-18T01:15:57.313 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 55834574857 2026-02-18T01:15:57.313 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:15:57.528 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-18T01:15:57.529 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:15:57.529 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:15:57.529 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:15:57.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:15:57.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:15:57.819 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:15:57.819 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:15:57.819 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:15:57.819 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:15:57.819 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:15:57.819 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:15:58.038 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-18T01:15:58.038 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:15:58.039 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:15:58.039 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:15:58.325 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-18T01:15:58.326 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:15:58.326 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:15:58.326 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: get_pg test existing_1 2026-02-18T01:15:58.327 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-18T01:15:58.327 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-18T01:15:58.327 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-18T01:15:58.327 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-18T01:15:58.545 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: local pgid=1.0 2026-02-18T01:15:58.545 INFO:tasks.workunit.client.0.trial080.stdout:blackholing osds 0 2 2026-02-18T01:15:58.546 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: echo 'blackholing osds 0 2' 2026-02-18T01:15:58.546 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:105: TEST_divergent: ceph pg dump pgs 2026-02-18T01:15:58.746 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:15:58.747 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-18T01:15:44.883701+0000 26'100 26:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 periodic scrub scheduled @ 2026-02-19T07:58:44.559448+0000 0 0 2026-02-18T01:15:58.747 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:15:58.747 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:15:58.747 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:15:58.755 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-18T01:15:58.756 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.0 2026-02-18T01:15:58.756 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T01:15:58.756 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T01:15:58.757 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:15:58.757 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:58.757 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:58.757 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.0.asok 2026-02-18T01:15:58.757 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-18T01:15:58.757 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-18T01:15:58.811 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:15:58.811 INFO:tasks.workunit.client.0.trial080.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-18T01:15:58.811 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:15:58.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-18T01:15:58.817 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.2 2026-02-18T01:15:58.817 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-18T01:15:58.817 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-18T01:15:58.818 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:15:58.818 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:58.818 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:58.818 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.2.asok 2026-02-18T01:15:58.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-18T01:15:58.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-18T01:15:58.872 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:15:58.872 INFO:tasks.workunit.client.0.trial080.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-18T01:15:58.872 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:15:58.877 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: local case5=100 2026-02-18T01:15:58.878 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: expr 100 - 1 2026-02-18T01:15:58.879 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: local case3=99 2026-02-18T01:15:58.880 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:114: TEST_divergent: echo 'writing divergent object' 2026-02-18T01:15:58.880 INFO:tasks.workunit.client.0.trial080.stdout:writing divergent object 2026-02-18T01:15:58.880 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:116: TEST_divergent: echo 'create missing divergent object' 2026-02-18T01:15:58.881 INFO:tasks.workunit.client.0.trial080.stdout:create missing divergent object 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:117: TEST_divergent: inject_eio rep data test existing_99 td/divergent-priors 0 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=rep 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=test 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=existing_99 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: rados -p test put existing_100 /tmp/tmp.ZarSjo5J6P 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/divergent-priors 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds test existing_99 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=existing_99 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test existing_99 2026-02-18T01:15:58.882 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T01:15:59.098 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-18T01:15:59.098 INFO:tasks.workunit.client.0.trial080.stderr:0 2026-02-18T01:15:59.099 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:15:59.099 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 2026-02-18T01:15:59.099 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('1' '0' '2') 2026-02-18T01:15:59.099 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T01:15:59.099 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-18T01:15:59.099 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' rep '!=' ec ']' 2026-02-18T01:15:59.099 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2497: inject_eio: shard_id= 2026-02-18T01:15:59.100 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/divergent-priors/1/type 2026-02-18T01:15:59.100 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T01:15:59.100 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-18T01:15:59.100 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T01:15:59.100 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-18T01:15:59.101 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T01:15:59.101 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T01:15:59.102 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T01:15:59.102 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-18T01:15:59.102 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T01:15:59.102 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T01:15:59.102 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:15:59.102 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:59.102 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:59.103 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.1.asok 2026-02-18T01:15:59.103 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.16037/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-18T01:15:59.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T01:15:59.163 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T01:15:59.164 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T01:15:59.164 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-18T01:15:59.164 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T01:15:59.164 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T01:15:59.165 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:15:59.165 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:15:59.165 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:15:59.165 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.1.asok 2026-02-18T01:15:59.166 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T01:15:59.166 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.1.asok injectdataerr test existing_99 2026-02-18T01:15:59.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:119: TEST_divergent: sleep 10 2026-02-18T01:15:59.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:118: TEST_divergent: rados -p test get existing_99 td/divergent-priors/existing 2026-02-18T01:16:09.225 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:120: TEST_divergent: killall -9 rados 2026-02-18T01:16:09.275 INFO:tasks.workunit.client.0.trial080.stderr:rados: no process found 2026-02-18T01:16:09.275 INFO:tasks.workunit.client.0.trial080.stdout:killing all the osds 2026-02-18T01:16:09.275 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:123: TEST_divergent: echo 'killing all the osds' 2026-02-18T01:16:09.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:124: TEST_divergent: ceph pg dump pgs 2026-02-18T01:16:09.492 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:16:09.492 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 active+clean 2026-02-18T01:15:59.243001+0000 26'101 26:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 periodic scrub scheduled @ 2026-02-19T07:58:44.559448+0000 0 0 2026-02-18T01:16:09.492 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:16:09.492 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:16:09.492 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:16:09.500 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:125: TEST_divergent: kill_daemons td/divergent-priors KILL osd 2026-02-18T01:16:09.501 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:16:09.501 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:16:09.501 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:16:09.501 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:16:09.501 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:16:09.610 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:16:09.610 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-18T01:16:09.610 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.0 2026-02-18T01:16:09.872 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already down. 2026-02-18T01:16:09.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-18T01:16:09.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.1 2026-02-18T01:16:10.142 INFO:tasks.workunit.client.0.trial080.stderr:osd.1 is already down. 2026-02-18T01:16:10.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-18T01:16:10.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.2 2026-02-18T01:16:10.428 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already down. 2026-02-18T01:16:10.439 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-18T01:16:10.439 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.0 2026-02-18T01:16:10.713 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already out. 2026-02-18T01:16:10.723 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-18T01:16:10.723 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.2 2026-02-18T01:16:11.000 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already out. 2026-02-18T01:16:11.010 INFO:tasks.workunit.client.0.trial080.stdout:bringing up non_divergent 0 2 2026-02-18T01:16:11.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:136: TEST_divergent: echo 'bringing up non_divergent 0 2' 2026-02-18T01:16:11.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:137: TEST_divergent: ceph pg dump pgs 2026-02-18T01:16:11.222 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:16:11.222 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 stale+active+clean 2026-02-18T01:15:59.243001+0000 26'101 26:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 periodic scrub scheduled @ 2026-02-19T07:58:44.559448+0000 0 0 2026-02-18T01:16:11.222 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:16:11.222 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:16:11.222 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:16:11.233 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-18T01:16:11.233 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 0 2026-02-18T01:16:11.233 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:16:11.233 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:16:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:16:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:16:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-18T01:16:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:16:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:16:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:16:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:16:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-18T01:16:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-18T01:16:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:16:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:16:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:16:11.235 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:16:11.235 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:16:11.235 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:16:11.235 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:16:11.235 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:16:11.235 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:16:11.235 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:16:11.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:16:11.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:16:11.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:16:11.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:16:11.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:16:11.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:16:11.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:16:11.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:16:11.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:16:11.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:16:11.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-18T01:16:11.236 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:16:11.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:16:11.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:16:11.238 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-18T01:16:11.238 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:16:11.238 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:16:11.238 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:16:11.238 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:16:11.256 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:11.250+0000 7fc93393ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:16:11.257 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:11.254+0000 7fc93393ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:16:11.258 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:11.254+0000 7fc93393ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:16:11.456 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:16:11.456 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:16:11.456 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:16:11.456 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:16:11.456 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:16:11.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:16:11.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:16:11.457 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:16:11.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:16:11.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:16:11.635 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:11.630+0000 7fc93393ba40 -1 Falling back to public interface 2026-02-18T01:16:11.675 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:16:12.272 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:12.266+0000 7fc93393ba40 -1 osd.0 26 log_to_monitors true 2026-02-18T01:16:12.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:16:12.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:16:12.677 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:16:12.678 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:16:12.678 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:16:12.678 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:16:12.894 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up out weight 0 up_from 33 up_thru 0 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6800/352632481,v1:127.0.0.1:6801/352632481] [v2:127.0.0.1:6802/352632481,v1:127.0.0.1:6803/352632481] exists,up 4de00105-d732-44db-9ff4-0950682771c4 2026-02-18T01:16:12.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:16:12.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:16:12.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:16:12.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-18T01:16:12.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 2 2026-02-18T01:16:12.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:16:12.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:16:12.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T01:16:12.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:16:12.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-18T01:16:12.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:16:12.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-18T01:16:12.898 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:16:12.899 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T01:16:12.899 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:16:12.899 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-18T01:16:12.899 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T01:16:12.899 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:16:12.899 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:16:12.899 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:16:12.917 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:12.914+0000 7ff6fbf30a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:16:12.919 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:12.914+0000 7ff6fbf30a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:16:12.920 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:12.914+0000 7ff6fbf30a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:16:13.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T01:16:13.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:16:13.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:16:13.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:16:13.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:16:13.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:16:13.111 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:16:13.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:16:13.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:16:13.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:16:13.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:16:13.375 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:13.370+0000 7ff6fbf30a40 -1 Falling back to public interface 2026-02-18T01:16:14.027 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:14.022+0000 7ff6fbf30a40 -1 osd.2 26 log_to_monitors true 2026-02-18T01:16:14.325 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:16:14.325 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:16:14.326 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:16:14.326 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:16:14.326 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:16:14.326 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:16:14.542 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [13,26) [v2:127.0.0.1:6810/2180328397,v1:127.0.0.1:6811/2180328397] [v2:127.0.0.1:6812/2180328397,v1:127.0.0.1:6813/2180328397] exists,up 5e478b18-d9ae-45fa-aeac-1283d483e8bb 2026-02-18T01:16:14.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:16:14.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:16:14.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:16:14.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-18T01:16:14.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.0 2026-02-18T01:16:14.788 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already in. 2026-02-18T01:16:14.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-18T01:16:14.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.2 2026-02-18T01:16:15.071 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already in. 2026-02-18T01:16:15.081 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-18T01:16:15.081 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: wait_for_clean 2026-02-18T01:16:15.081 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:16:15.081 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:16:15.081 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:16:15.082 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-18T01:16:15.082 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:16:15.083 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:16:15.083 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:16:15.083 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:16:15.083 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:16:15.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-18T01:16:15.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:16:15.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:16:15.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:16:15.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:16:15.145 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:16:15.356 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:16:15.356 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:16:15.356 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:16:15.356 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:16:15.356 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:16:15.357 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:16:15.441 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920771 2026-02-18T01:16:15.441 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920771 2026-02-18T01:16:15.441 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-141733920771' 2026-02-18T01:16:15.441 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:16:15.441 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:16:15.501 INFO:tasks.workunit.client.0.trial080.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-18T01:16:15.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-18T01:16:15.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-18T01:16:15.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-18T01:16:15.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:16:15.504 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:16:15.581 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-18T01:16:15.581 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-18T01:16:15.581 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-141733920771 2-150323855363' 2026-02-18T01:16:15.581 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:16:15.582 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-141733920771 2026-02-18T01:16:15.582 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:16:15.582 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:16:15.583 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-141733920771 2026-02-18T01:16:15.583 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:16:15.584 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920771 2026-02-18T01:16:15.584 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 141733920771 2026-02-18T01:16:15.584 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 141733920771' 2026-02-18T01:16:15.585 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:16:15.803 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 141733920771 2026-02-18T01:16:15.803 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:16:16.804 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:16:16.805 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:16:17.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920771 -lt 141733920771 2026-02-18T01:16:17.023 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:16:17.023 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-150323855363 2026-02-18T01:16:17.023 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:16:17.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:16:17.025 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-150323855363 2026-02-18T01:16:17.025 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:16:17.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=150323855363 2026-02-18T01:16:17.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 150323855363' 2026-02-18T01:16:17.027 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 150323855363 2026-02-18T01:16:17.027 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:16:17.243 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-18T01:16:17.244 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:16:17.245 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:16:17.245 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:16:17.528 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:16:17.529 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:16:17.529 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:16:17.529 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:16:17.529 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:16:17.529 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:16:17.529 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:16:17.529 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:16:17.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:16:17.734 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:16:17.734 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:16:17.734 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:16:18.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:16:18.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-18T01:16:18.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-18T01:16:18.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-18T01:16:18.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:16:18.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-18T01:16:18.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:16:18.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:16:18.111 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:16:18.111 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:16:18.111 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:16:18.111 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:16:18.112 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:16:18.112 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:16:18.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:16:18.321 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:16:18.321 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:16:18.321 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:16:18.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:16:18.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:16:18.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:16:18.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:16:18.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:16:18.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:16:18.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:16:18.599 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:16:18.599 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:16:18.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:16:18.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:16:18.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-18T01:16:18.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:16:18.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-18T01:16:19.075 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:16:19.076 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:16:19.077 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:16:19.077 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:16:19.077 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:16:19.077 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:16:19.077 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:16:19.077 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:16:19.284 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:16:19.285 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:16:19.285 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:16:19.285 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:16:19.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:16:19.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:16:19.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:16:19.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:16:19.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:16:19.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:16:19.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:16:19.563 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:16:19.564 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:16:19.841 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:16:19.841 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:16:19.841 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-18T01:16:19.841 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:16:19.841 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-18T01:16:20.242 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:16:20.242 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:16:20.243 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:16:20.243 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:16:20.243 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:16:20.243 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:16:20.243 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:16:20.243 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:16:20.450 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:16:20.450 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:16:20.451 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:16:20.451 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:16:20.730 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:16:20.730 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:16:20.730 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:16:20.730 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:16:20.731 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:16:20.731 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:16:20.731 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:16:20.731 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:16:20.731 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:16:21.005 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:16:21.005 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:16:21.005 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-18T01:16:21.006 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:16:21.006 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-18T01:16:21.806 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:16:21.806 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:16:21.807 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:16:21.807 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:16:21.807 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:16:21.807 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:16:21.808 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:16:21.808 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:16:22.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:16:22.020 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:16:22.021 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:16:22.021 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:16:22.298 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:16:22.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:16:22.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:16:22.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:16:22.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:16:22.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:16:22.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:16:22.299 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:16:22.299 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:16:22.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:16:22.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:16:22.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-18T01:16:22.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:16:22.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-18T01:16:24.176 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:16:24.177 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:16:24.178 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:16:24.178 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:16:24.178 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:16:24.178 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:16:24.178 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:16:24.178 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:16:24.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:16:24.387 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:16:24.388 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:16:24.388 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:16:24.672 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:16:24.673 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:16:24.673 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:16:24.673 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:16:24.673 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:16:24.673 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:16:24.673 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:16:24.674 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:16:24.674 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:16:24.955 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:16:24.956 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:16:24.956 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-18T01:16:24.956 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:16:24.956 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-18T01:16:28.156 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:16:28.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:16:28.158 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:16:28.158 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:16:28.158 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:16:28.158 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:16:28.158 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:16:28.158 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:16:28.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:16:28.375 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:16:28.375 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:16:28.375 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:16:28.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:16:28.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:16:28.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:16:28.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:16:28.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:16:28.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:16:28.659 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:16:28.659 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:16:28.659 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:16:28.935 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:16:28.935 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:16:28.935 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-18T01:16:28.935 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:16:28.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-18T01:16:35.336 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:16:35.336 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:16:35.337 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:16:35.337 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:16:35.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:16:35.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:16:35.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:16:35.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:16:35.544 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:16:35.545 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:16:35.545 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:16:35.545 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:16:35.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:16:35.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:16:35.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:16:35.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:16:35.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:16:35.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:16:35.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:16:35.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:16:35.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:16:36.102 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:16:36.103 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:16:36.103 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-18T01:16:36.103 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:16:36.103 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-18T01:16:43.403 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:16:43.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:16:43.405 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:16:43.405 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:16:43.405 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:16:43.405 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:16:43.405 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:16:43.405 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:16:43.612 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:16:43.612 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:16:43.613 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:16:43.613 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:16:43.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:16:43.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:16:43.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:16:43.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:16:43.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:16:43.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:16:43.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:16:43.887 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:16:43.888 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:16:44.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:16:44.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:16:44.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-18T01:16:44.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-18T01:16:44.440 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:16:44.440 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_fingerprint": "d522344c-d1eb-4c0e-acf4-63dce703ba70", 2026-02-18T01:16:44.440 INFO:tasks.workunit.client.0.trial080.stdout: "version": "20.2.0-670-gadc19233", 2026-02-18T01:16:44.440 INFO:tasks.workunit.client.0.trial080.stdout: "commit": "adc1923395f2bcd6ae89b5d331d278364d1848ed", 2026-02-18T01:16:44.440 INFO:tasks.workunit.client.0.trial080.stdout: "timestamp": "2026-02-18T01:16:44.436345+0000", 2026-02-18T01:16:44.440 INFO:tasks.workunit.client.0.trial080.stdout: "tag": "", 2026-02-18T01:16:44.440 INFO:tasks.workunit.client.0.trial080.stdout: "health": { 2026-02-18T01:16:44.440 INFO:tasks.workunit.client.0.trial080.stdout: "status": "HEALTH_WARN", 2026-02-18T01:16:44.440 INFO:tasks.workunit.client.0.trial080.stdout: "checks": { 2026-02-18T01:16:44.440 INFO:tasks.workunit.client.0.trial080.stdout: "OSDMAP_FLAGS": { 2026-02-18T01:16:44.440 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:16:44.440 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "count": 17 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [], 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "OSD_DOWN": { 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "message": "1 osds down", 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "count": 1 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "message": "osd.1 (root=default,host=trial080) is down" 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "PG_DEGRADED": { 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "count": 1 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "mutes": [] 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_first_committed": 1, 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_last_committed": 1, 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "monmap": { 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:15:31.433281Z", 2026-02-18T01:16:44.441 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:15:31.433281Z", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release": 20, 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release_name": "tentacle", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "election_strategy": 1, 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "disallowed_leaders": "", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": false, 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "tiebreaker_mon": "", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "removed_ranks": "", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "features": { 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "persistent": [ 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "kraken", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "luminous", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "mimic", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap-prune", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "nautilus", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "octopus", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "pacific", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "elector-pinging", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "quincy", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "reef", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "squid", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "tentacle", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "nvmeof_beacon_diff" 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "optional": [] 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "mons": [ 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "rank": 0, 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "name": "a", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 0 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115/0", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "priority": 0, 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 0, 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: "crush_location": "{}" 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.442 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "quorum": [ 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: 0 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap": { 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 38, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:15:31.515875+0000", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:16:15.115915+0000", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "last_up_change": "2026-02-18T01:16:14.172992+0000", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "last_in_change": "2026-02-18T01:16:15.012683+0000", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "flags_num": 5800384, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "flags_set": [ 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "nodown", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "noin", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "noout", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "pglog_hardlimit", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snapdirs", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "recovery_deletes", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "sortbitwise" 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "crush_version": 9, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "full_ratio": 0.99000000953674316, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_snapshot": "", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "pool_max": 1, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "max_osd": 3, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "require_min_compat_client": "luminous", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "min_compat_client": "jewel", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "require_osd_release": "tentacle", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "allow_crimson": false, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "pools": [ 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "pool_name": "test", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "create_time": "2026-02-18T01:15:44.639286+0000", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "flags": 1, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "flags_names": "hashpspool", 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "type": 1, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "size": 3, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "min_size": 2, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "crush_rule": 0, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_count": 0, 2026-02-18T01:16:44.443 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_target": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_barrier": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "is_stretch_pool": false, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "object_hash": 2, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "pg_autoscale_mode": "off", 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num": 1, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num": 1, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num_target": 1, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_target": 1, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_pending": 1, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "last_pg_merge_meta": { 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "source_pgid": "0.0", 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "ready_epoch": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_started": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "source_version": "0'0", 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "target_version": "0'0" 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "last_change": "26", 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend": "0", 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_preluminous": "0", 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "auid": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "snap_mode": "selfmanaged", 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "snap_seq": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "snap_epoch": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "pool_snaps": [], 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps": "[]", 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_bytes": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_objects": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "tiers": [], 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "tier_of": -1, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "read_tier": -1, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "write_tier": -1, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "cache_mode": "none", 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_bytes": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_objects": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_flush_age": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_evict_age": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profile": "", 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_params": { 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "type": "none" 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_period": 0, 2026-02-18T01:16:44.444 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_count": 0, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "use_gmt_hitset": true, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "min_read_recency_for_promote": 0, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "min_write_recency_for_promote": 0, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_grade_decay_rate": 0, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_search_last_n": 0, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "grade_table": [], 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "stripe_width": 0, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "expected_num_objects": 0, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "fast_read": false, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "nonprimary_shards": "{}", 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "options": {}, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "application_metadata": {}, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "read_balance": { 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "score_type": "Fair distribution", 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "score_acting": 2.9900000095367432, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "score_stable": 2.9900000095367432, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "optimal_score": 0.67000001668930054, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "raw_score_acting": 2, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "raw_score_stable": 2, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity_weighted": 1, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "average_primary_affinity": 1, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "average_primary_affinity_weighted": 1 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "osds": [ 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "4de00105-d732-44db-9ff4-0950682771c4", 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 5, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 26, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 33, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 37, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 27, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6800", 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 352632481 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.445 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6801", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 352632481 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6802", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 352632481 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6803", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 352632481 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6806", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 352632481 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6807", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 352632481 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6804", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 352632481 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6805", 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 352632481 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.446 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6801/352632481", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6803/352632481", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6807/352632481", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6805/352632481", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "29c54dd7-a960-4aaf-b76a-6e4983f7a2cc", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "up": 0, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 0, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 0, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 9, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 20, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 28, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2540213220 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2540213220 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2540213220 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2540213220 2026-02-18T01:16:44.447 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2540213220 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2540213220 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2540213220 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2540213220 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/2540213220", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/2540213220", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2540213220", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2540213220", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "exists" 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "5e478b18-d9ae-45fa-aeac-1283d483e8bb", 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 13, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 26, 2026-02-18T01:16:44.448 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 35, 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 0, 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 29, 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2180328397 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2180328397 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2180328397 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2180328397 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2180328397 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2180328397 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:16:44.449 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2180328397 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2180328397 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/2180328397", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/2180328397", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2180328397", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2180328397", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "osd_xinfo": [ 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:16:09.813558+0000", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:16:10.084607+0000", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:16:10.370780+0000", 2026-02-18T01:16:44.450 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap": [], 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_items": [], 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_primaries": [], 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "pg_temp": [], 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "primary_temp": [], 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "blocklist": {}, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "range_blocklist": {}, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profiles": { 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "default": { 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "k": "2", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "m": "2", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "plugin": "isa", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "technique": "reed_sol_van" 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps_queue": [], 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "new_removed_snaps": [], 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "new_purged_snaps": [], 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "crush_node_flags": {}, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "device_class_flags": {}, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": { 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_enabled": false, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_bucket_count": 0, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "degraded_stretch_mode": 0, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "recovering_stretch_mode": 0, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_bucket": 0 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "osd_metadata": [ 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6802/352632481,v1:127.0.0.1:6803/352632481]", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:16:44.451 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:15:32.490900Z", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6800/352632481,v1:127.0.0.1:6801/352632481]", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/352632481,v1:127.0.0.1:6807/352632481]", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/352632481,v1:127.0.0.1:6805/352632481]", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/0", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:16:44.452 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/2540213220,v1:127.0.0.1:6813/2540213220]", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:15:36.253633Z", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/2540213220,v1:127.0.0.1:6811/2540213220]", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2540213220,v1:127.0.0.1:6817/2540213220]", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2540213220,v1:127.0.0.1:6815/2540213220]", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:16:44.453 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/1", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/2180328397,v1:127.0.0.1:6813/2180328397]", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:15:40.321634Z", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/2180328397,v1:127.0.0.1:6811/2180328397]", 2026-02-18T01:16:44.454 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2180328397,v1:127.0.0.1:6817/2180328397]", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2180328397,v1:127.0.0.1:6815/2180328397]", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/2", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_clean_epochs": { 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "min_last_epoch_clean": 0, 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": { 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "per_pool": [] 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "osd_epochs": [] 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_first_committed": 1, 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_last_committed": 38, 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "crushmap": { 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "devices": [ 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.0", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.1", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.2", 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "types": [ 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.455 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 0, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd" 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "name": "host" 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 2, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "name": "chassis" 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 3, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "name": "rack" 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 4, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "name": "row" 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 5, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pdu" 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 6, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pod" 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 7, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "name": "room" 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 8, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "name": "datacenter" 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 9, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "name": "zone" 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 10, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "name": "region" 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "name": "root" 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: "buckets": [ 2026-02-18T01:16:44.456 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "id": -1, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default", 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "id": -2, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default~ssd", 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080", 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:16:44.457 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080~ssd", 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "rules": [ 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "rule_id": 0, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "rule_name": "replicated_rule", 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "type": 1, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "steps": [ 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "op": "take", 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "item": -1, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: "item_name": "default" 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.458 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "op": "choose_firstn", 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "num": 0, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "type": "osd" 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "op": "emit" 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "tunables": { 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_tries": 0, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_fallback_tries": 0, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "choose_total_tries": 50, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_descend_once": 1, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_vary_r": 1, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_stable": 1, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "msr_descents": 100, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "msr_collision_tries": 100, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "straw_calc_version": 1, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "allowed_bucket_algs": 54, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "profile": "jewel", 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "optimal_tunables": 1, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "legacy_tunables": 0, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "minimum_required_version": "jewel", 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables": 1, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables2": 1, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "has_v2_rules": 0, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables3": 1, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "has_v3_rules": 0, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "has_v4_buckets": 1, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables5": 1, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "has_v5_rules": 0, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "has_msr_rules": 0 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "choose_args": {} 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "fsmap": { 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "btime": "2026-02-18T01:15:31:515659+0000", 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "default_fscid": -1, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "compat": { 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "compat": {}, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "ro_compat": {}, 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "incompat": { 2026-02-18T01:16:44.459 INFO:tasks.workunit.client.0.trial080.stdout: "feature_1": "base v0.20", 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stderr:report 1836616310 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "feature_2": "client writeable ranges", 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "feature_3": "default file layouts on dirs", 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "feature_4": "dir inode in separate object", 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "feature_5": "mds uses versioned encoding", 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "feature_8": "no anchor table", 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "feature_9": "file layout v2", 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "feature_10": "snaprealm v2", 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "feature_11": "minor log segments", 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "feature_12": "quiesce subvolumes" 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "feature_flags": { 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "enable_multiple": true, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "ever_enabled_multiple": true 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "standbys": [], 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "filesystems": [] 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_first_committed": 1, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_last_committed": 1, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "auth": { 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 5, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "num_secrets": 3 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 1, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_active": 1, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_unknown": 0, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "num_osd": 3, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "pool_sum": { 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 51200, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 100, 2026-02-18T01:16:44.460 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 300, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 100, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 100, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 100, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 100, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:16:44.461 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 16, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 16, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "up": 2, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 2, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 0 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum": { 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 3, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 83820, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2040, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 24, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 81703, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314488980, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322036715520, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2088960, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 410164, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 25396, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 83664076 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 1, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.462 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum_by_class": { 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "ssd": { 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 3, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 83820, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2040, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 24, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 81703, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314488980, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322036715520, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2088960, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 410164, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 25396, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 83664076 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 1, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "pool_stats": [ 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.463 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": 1, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 1, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 51200, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 100, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 300, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 100, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 100, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 100, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 100, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 1228800, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 153600, 2026-02-18T01:16:44.464 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 16, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 16, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "up": 2, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 2, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 3 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "osd_stats": [ 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 141733920777 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 38654705677 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 150323855368 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_state": [ 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "state": "active+undersized+degraded", 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "num": 1 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "pool_pg_unavailable_map": [ 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": "1", 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "pgs": [] 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_osd": [ 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 1, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:16:44.465 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 1, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 1, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 0, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": [ 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": {} 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "servicemap": { 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 3, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:16:39.922953+0000", 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "services": { 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "osd": { 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "daemons": { 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "summary": "", 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "0": { 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "start_epoch": 0, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "start_stamp": "0.000000", 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "gid": 0, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "metadata": {}, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "task_status": {} 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "2": { 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "start_epoch": 0, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "start_stamp": "0.000000", 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "gid": 0, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "metadata": {}, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "task_status": {} 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_first_committed": 1, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_last_committed": 37, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "logm_first_committed": 1, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "logm_last_committed": 219, 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "paxos": { 2026-02-18T01:16:44.466 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:16:44.467 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 305, 2026-02-18T01:16:44.467 INFO:tasks.workunit.client.0.trial080.stdout: "last_pn": 0, 2026-02-18T01:16:44.467 INFO:tasks.workunit.client.0.trial080.stdout: "accepted_pn": 0 2026-02-18T01:16:44.467 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:16:44.467 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:16:44.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-18T01:16:44.467 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: expr 2 + 2 2026-02-18T01:16:44.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: objname=existing_4 2026-02-18T01:16:44.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:151: TEST_divergent: echo 'writing non-divergent object existing_4' 2026-02-18T01:16:44.467 INFO:tasks.workunit.client.0.trial080.stdout:writing non-divergent object existing_4 2026-02-18T01:16:44.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:152: TEST_divergent: ceph pg dump pgs 2026-02-18T01:16:44.649 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:16:44.649 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:16:15.120008+0000 26'100 38:130 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:42:16.010444+0000 0 0 2026-02-18T01:16:44.649 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:16:44.649 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:16:44.650 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:16:44.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: dd if=/dev/urandom bs=1000 count=1 2026-02-18T01:16:44.659 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: rados -p test put existing_4 - 2026-02-18T01:16:44.660 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records in 2026-02-18T01:16:44.660 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records out 2026-02-18T01:16:44.660 INFO:tasks.workunit.client.0.trial080.stderr:1000 bytes (1.0 kB) copied, 2.0458e-05 s, 48.9 MB/s 2026-02-18T01:16:44.681 INFO:tasks.workunit.client.0.trial080.stdout:delay recovery 2026-02-18T01:16:44.682 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:157: TEST_divergent: echo 'delay recovery' 2026-02-18T01:16:44.682 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:158: TEST_divergent: ceph pg dump pgs 2026-02-18T01:16:44.886 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:16:44.886 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:16:15.120008+0000 26'100 38:130 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:42:16.010444+0000 0 0 2026-02-18T01:16:44.887 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:16:44.887 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:16:44.887 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:16:44.895 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-18T01:16:44.896 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.0 2026-02-18T01:16:44.896 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T01:16:44.896 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T01:16:44.897 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:16:44.897 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:16:44.897 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:16:44.897 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.0.asok 2026-02-18T01:16:44.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-18T01:16:44.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.0.asok set_recovery_delay 100000 2026-02-18T01:16:44.951 INFO:tasks.workunit.client.0.trial080.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-18T01:16:44.956 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-18T01:16:44.957 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.2 2026-02-18T01:16:44.957 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-18T01:16:44.958 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-18T01:16:44.958 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:16:44.958 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:16:44.958 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:16:44.958 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.2.asok 2026-02-18T01:16:44.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-18T01:16:44.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.2.asok set_recovery_delay 100000 2026-02-18T01:16:45.012 INFO:tasks.workunit.client.0.trial080.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-18T01:16:45.018 INFO:tasks.workunit.client.0.trial080.stdout:revive divergent 1 2026-02-18T01:16:45.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:165: TEST_divergent: echo 'revive divergent 1' 2026-02-18T01:16:45.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:166: TEST_divergent: ceph pg dump pgs 2026-02-18T01:16:45.227 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:16:45.227 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:16:15.120008+0000 26'100 38:130 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:42:16.010444+0000 0 0 2026-02-18T01:16:45.227 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:16:45.227 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:16:45.228 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:16:45.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:167: TEST_divergent: ceph osd set noup 2026-02-18T01:16:45.560 INFO:tasks.workunit.client.0.trial080.stderr:noup is set 2026-02-18T01:16:45.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:168: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-18T01:16:45.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:16:45.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:16:45.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:16:45.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:16:45.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-18T01:16:45.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:16:45.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:16:45.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:16:45.576 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:16:45.576 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-18T01:16:45.576 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-18T01:16:45.576 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:16:45.576 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:16:45.576 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:16:45.576 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:16:45.576 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:16:45.576 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:16:45.576 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:16:45.576 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:16:45.576 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:16:45.577 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:16:45.577 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:16:45.577 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:16:45.577 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:16:45.577 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:16:45.577 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:16:45.577 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:16:45.577 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:16:45.577 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:16:45.577 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:16:45.577 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:16:45.577 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-18T01:16:45.578 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:16:45.579 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:16:45.579 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:16:45.579 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-18T01:16:45.579 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:16:45.579 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:16:45.579 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:16:45.579 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:16:45.602 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:45.597+0000 7feb0298ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:16:45.603 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:45.597+0000 7feb0298ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:16:45.604 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:45.597+0000 7feb0298ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:16:45.795 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-18T01:16:45.795 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:169: TEST_divergent: sleep 5 2026-02-18T01:16:45.979 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:45.973+0000 7feb0298ca40 -1 Falling back to public interface 2026-02-18T01:16:46.632 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:46.625+0000 7feb0298ca40 -1 osd.1 26 log_to_monitors true 2026-02-18T01:16:50.797 INFO:tasks.workunit.client.0.trial080.stdout:delay recovery divergent 2026-02-18T01:16:50.797 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:171: TEST_divergent: echo 'delay recovery divergent' 2026-02-18T01:16:50.797 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:172: TEST_divergent: ceph pg dump pgs 2026-02-18T01:16:50.994 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:16:50.994 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-18T01:16:15.120008+0000 38'101 41:136 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:42:16.010444+0000 0 0 2026-02-18T01:16:50.994 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:16:50.994 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:16:50.994 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:16:51.003 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: get_asok_path osd.1 2026-02-18T01:16:51.003 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T01:16:51.003 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T01:16:51.003 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:16:51.003 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:16:51.004 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:16:51.004 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.1.asok 2026-02-18T01:16:51.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: CEPH_ARGS= 2026-02-18T01:16:51.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.1.asok set_recovery_delay 100000 2026-02-18T01:16:51.057 INFO:tasks.workunit.client.0.trial080.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-18T01:16:51.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: ceph osd unset noup 2026-02-18T01:16:51.385 INFO:tasks.workunit.client.0.trial080.stderr:noup is unset 2026-02-18T01:16:51.399 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:177: TEST_divergent: wait_for_osd up 0 2026-02-18T01:16:51.399 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:16:51.399 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:16:51.400 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:16:51.400 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:16:51.400 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:16:51.400 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:16:51.400 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:16:51.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:16:51.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:16:51.609 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 33 up_thru 37 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6800/352632481,v1:127.0.0.1:6801/352632481] [v2:127.0.0.1:6802/352632481,v1:127.0.0.1:6803/352632481] exists,up 4de00105-d732-44db-9ff4-0950682771c4 2026-02-18T01:16:51.610 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:16:51.610 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:16:51.610 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:16:51.610 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:178: TEST_divergent: wait_for_osd up 1 2026-02-18T01:16:51.611 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:16:51.611 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:16:51.611 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:16:51.611 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:16:51.611 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:16:51.611 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:16:51.612 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:16:51.612 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:16:51.612 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:16:51.815 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 43 up_thru 43 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/172590776,v1:127.0.0.1:6819/172590776] [v2:127.0.0.1:6820/172590776,v1:127.0.0.1:6821/172590776] exists,up 29c54dd7-a960-4aaf-b76a-6e4983f7a2cc 2026-02-18T01:16:51.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:16:51.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:16:51.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:16:51.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:179: TEST_divergent: wait_for_osd up 2 2026-02-18T01:16:51.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:16:51.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:16:51.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:16:51.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:16:51.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:16:51.817 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:16:51.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:16:51.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:16:51.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:16:52.023 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 35 up_thru 0 down_at 29 last_clean_interval [13,26) [v2:127.0.0.1:6810/2180328397,v1:127.0.0.1:6811/2180328397] [v2:127.0.0.1:6812/2180328397,v1:127.0.0.1:6813/2180328397] exists,up 5e478b18-d9ae-45fa-aeac-1283d483e8bb 2026-02-18T01:16:52.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:16:52.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:16:52.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:16:52.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:181: TEST_divergent: ceph pg dump pgs 2026-02-18T01:16:52.219 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:16:52.219 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 peering 2026-02-18T01:16:51.384048+0000 26'101 43:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:16:52.220 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:16:52.220 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:16:52.220 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:16:52.228 INFO:tasks.workunit.client.0.trial080.stdout:wait for peering 2026-02-18T01:16:52.228 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:182: TEST_divergent: echo 'wait for peering' 2026-02-18T01:16:52.228 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:183: TEST_divergent: ceph pg dump pgs 2026-02-18T01:16:52.444 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:16:52.444 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 peering 2026-02-18T01:16:51.384048+0000 26'101 43:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:16:52.444 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:16:52.444 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:16:52.445 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:16:52.454 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:184: TEST_divergent: rados -p test put foo /tmp/tmp.ZarSjo5J6P 2026-02-18T01:16:52.477 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:186: TEST_divergent: echo 'killing divergent 1' 2026-02-18T01:16:52.477 INFO:tasks.workunit.client.0.trial080.stdout:killing divergent 1 2026-02-18T01:16:52.477 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:187: TEST_divergent: ceph pg dump pgs 2026-02-18T01:16:52.691 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:16:52.691 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 peering 2026-02-18T01:16:51.384048+0000 26'101 43:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:16:52.691 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:16:52.691 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:16:52.691 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:16:52.699 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:188: TEST_divergent: kill_daemons td/divergent-priors KILL osd.1 2026-02-18T01:16:52.700 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:16:52.700 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:16:52.700 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:16:52.700 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:16:52.700 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:16:52.807 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:16:52.808 INFO:tasks.workunit.client.0.trial080.stdout:reviving divergent 1 2026-02-18T01:16:52.808 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:190: TEST_divergent: echo 'reviving divergent 1' 2026-02-18T01:16:52.808 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:191: TEST_divergent: ceph pg dump pgs 2026-02-18T01:16:53.005 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:16:53.005 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 peering 2026-02-18T01:16:51.384048+0000 26'101 43:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:16:53.005 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:16:53.005 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:16:53.005 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:16:53.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:192: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-18T01:16:53.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:16:53.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:16:53.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:16:53.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:16:53.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-18T01:16:53.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:16:53.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:16:53.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:16:53.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:16:53.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-18T01:16:53.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-18T01:16:53.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:16:53.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:16:53.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:16:53.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:16:53.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:16:53.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:16:53.019 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:16:53.020 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:16:53.020 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:16:53.020 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:16:53.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:16:53.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:16:53.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:16:53.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:16:53.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:16:53.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:16:53.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:16:53.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:16:53.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:16:53.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:16:53.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-18T01:16:53.021 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:16:53.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:16:53.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:16:53.022 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-18T01:16:53.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:16:53.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:16:53.023 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:16:53.023 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:16:53.041 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:53.033+0000 7fcb87bafa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:16:53.042 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:53.037+0000 7fcb87bafa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:16:53.043 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:53.037+0000 7fcb87bafa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:16:53.239 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T01:16:53.240 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:16:53.240 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:16:53.240 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:16:53.240 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:16:53.240 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:16:53.240 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:16:53.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:16:53.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:16:53.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:16:53.412 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:53.405+0000 7fcb87bafa40 -1 Falling back to public interface 2026-02-18T01:16:53.457 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 43 up_thru 43 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/172590776,v1:127.0.0.1:6819/172590776] [v2:127.0.0.1:6820/172590776,v1:127.0.0.1:6821/172590776] exists,up 29c54dd7-a960-4aaf-b76a-6e4983f7a2cc 2026-02-18T01:16:53.458 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:16:53.458 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:16:53.458 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:16:53.458 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:194: TEST_divergent: sleep 20 2026-02-18T01:16:54.063 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:16:54.057+0000 7fcb87bafa40 -1 osd.1 44 log_to_monitors true 2026-02-18T01:17:13.459 INFO:tasks.workunit.client.0.trial080.stdout:allowing recovery 2026-02-18T01:17:13.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:196: TEST_divergent: echo 'allowing recovery' 2026-02-18T01:17:13.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:197: TEST_divergent: ceph pg dump pgs 2026-02-18T01:17:13.657 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:17:13.657 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-18T01:16:55.243618+0000 44'102 48:159 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 periodic scrub scheduled @ 2026-02-19T11:46:29.352485+0000 0 0 2026-02-18T01:17:13.657 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:17:13.657 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:17:13.658 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:17:13.665 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-18T01:17:13.665 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-18T01:17:13.754 INFO:tasks.workunit.client.0.trial080.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-18T01:17:13.761 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-18T01:17:13.761 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-18T01:17:13.843 INFO:tasks.workunit.client.0.trial080.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-18T01:17:13.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-18T01:17:13.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-18T01:17:13.931 INFO:tasks.workunit.client.0.trial080.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-18T01:17:13.938 INFO:tasks.workunit.client.0.trial080.stdout:reading divergent objects 2026-02-18T01:17:13.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:204: TEST_divergent: echo 'reading divergent objects' 2026-02-18T01:17:13.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:205: TEST_divergent: ceph pg dump pgs 2026-02-18T01:17:14.149 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:17:14.149 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-18T01:16:55.243618+0000 44'102 48:159 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:15:44.673732+0000 0'0 2026-02-18T01:15:44.673732+0000 0 0 periodic scrub scheduled @ 2026-02-19T11:46:29.352485+0000 0 0 2026-02-18T01:17:14.149 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:17:14.149 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:17:14.150 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:17:14.158 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: expr 2 + 2 2026-02-18T01:17:14.159 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: seq 1 4 2026-02-18T01:17:14.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:17:14.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_1 td/divergent-priors/existing 2026-02-18T01:17:14.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:17:14.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_2 td/divergent-priors/existing 2026-02-18T01:17:14.212 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:17:14.212 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_3 td/divergent-priors/existing 2026-02-18T01:17:14.240 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:17:14.240 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_4 td/divergent-priors/existing 2026-02-18T01:17:14.268 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rm -f td/divergent-priors/existing 2026-02-18T01:17:14.269 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-18T01:17:14.271 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-18T01:17:14.275 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:16:52.245+0000 7feae0109640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-18T01:15:58.896082+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-18T01:17:14.275 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:16:52.245+0000 7feae0109640 20 _merge_object_divergent_entries: keeping 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-18T01:15:58.896082+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-18T01:17:14.275 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:16:52.245+0000 7feae0109640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:17:14.275 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:16:52.245+0000 7feae0109640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 26'100 first_divergent_update: 26'101 last_divergent_update: 26'101 2026-02-18T01:17:14.275 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:16:52.245+0000 7feae0109640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-18T01:17:14.275 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:16:52.245+0000 7feae0109640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-18T01:17:14.275 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:16:52.245+0000 7feae0109640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 26'101 2026-02-18T01:17:14.275 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:16:52.245+0000 7feae0109640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-18T01:15:58.896082+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-18T01:17:14.275 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:16:52.245+0000 7feae0109640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-18T01:17:14.276 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-18T01:17:14.277 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: grep -q '_merge_object_divergent_entries.*cannot roll back, removing and adding to missing' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-18T01:17:14.279 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:219: TEST_divergent: echo success 2026-02-18T01:17:14.280 INFO:tasks.workunit.client.0.trial080.stdout:success 2026-02-18T01:17:14.280 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:221: TEST_divergent: rm -f /tmp/tmp.ZarSjo5J6P 2026-02-18T01:17:14.280 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:222: TEST_divergent: delete_pool test 2026-02-18T01:17:14.280 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-18T01:17:14.280 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-18T01:17:14.535 INFO:tasks.workunit.client.0.trial080.stderr:pool 'test' does not exist 2026-02-18T01:17:14.546 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:223: TEST_divergent: kill_daemons td/divergent-priors 2026-02-18T01:17:14.547 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:17:14.547 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:17:14.547 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:17:14.547 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:17:14.547 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:17:19.863 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:17:19.863 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-18T01:17:19.863 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-18T01:17:19.863 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:17:19.864 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-18T01:17:19.864 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:17:19.864 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:17:19.865 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:17:19.865 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:17:19.865 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:17:19.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:17:19.871 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:17:19.871 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:17:19.872 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:17:19.873 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:17:19.873 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:17:19.873 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:17:19.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:17:19.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:17:19.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:17:19.875 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:17:19.876 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:17:19.877 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:17:19.877 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-18T01:17:19.895 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:17:19.895 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:19.895 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:19.895 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16037 2026-02-18T01:17:19.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:17:19.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:17:19.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-18T01:17:19.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-18T01:17:19.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-18T01:17:19.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-18T01:17:19.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-18T01:17:19.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:17:19.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-18T01:17:19.898 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:17:19.898 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:17:19.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:17:19.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:17:19.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:17:19.899 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:17:19.900 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:17:19.900 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:17:19.901 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:17:19.902 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:17:19.903 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:17:19.903 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:17:19.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:17:19.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:17:19.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:17:19.904 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:17:19.905 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:17:19.906 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:17:19.907 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-18T01:17:19.908 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:17:19.908 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:19.908 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:19.909 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16037 2026-02-18T01:17:19.909 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:17:19.910 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:17:19.910 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-18T01:17:19.911 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:17:19.911 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:19.911 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:19.911 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16037 2026-02-18T01:17:19.914 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:17:19.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T01:17:19.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:17:19.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-18T01:17:19.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_2 td/divergent-priors 2026-02-18T01:17:19.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:422: TEST_divergent_2: local dir=td/divergent-priors 2026-02-18T01:17:19.914 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: file_with_random_data 2026-02-18T01:17:19.914 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=512 2026-02-18T01:17:19.914 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-18T01:17:19.915 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.j4BqkTY94A 2026-02-18T01:17:19.915 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.j4BqkTY94A bs=512 count=1 2026-02-18T01:17:19.916 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records in 2026-02-18T01:17:19.916 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records out 2026-02-18T01:17:19.916 INFO:tasks.workunit.client.0.trial080.stderr:512 bytes copied, 8.7161e-05 s, 5.9 MB/s 2026-02-18T01:17:19.916 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:19.916 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: local dummyfile=/tmp/tmp.j4BqkTY94A 2026-02-18T01:17:19.917 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: file_with_random_data 1000 2026-02-18T01:17:19.917 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=1000 2026-02-18T01:17:19.917 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-18T01:17:19.918 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.ea5sWwt2qu 2026-02-18T01:17:19.918 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.ea5sWwt2qu bs=1000 count=1 2026-02-18T01:17:19.919 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records in 2026-02-18T01:17:19.919 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records out 2026-02-18T01:17:19.919 INFO:tasks.workunit.client.0.trial080.stderr:1000 bytes (1.0 kB) copied, 4.8751e-05 s, 20.5 MB/s 2026-02-18T01:17:19.919 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.ea5sWwt2qu 2026-02-18T01:17:19.919 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: local dummyfile2=/tmp/tmp.ea5sWwt2qu 2026-02-18T01:17:19.919 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: local num_osds=3 2026-02-18T01:17:19.920 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: expr 3 - 1 2026-02-18T01:17:19.920 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: seq 0 2 2026-02-18T01:17:19.922 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: local 'osds=0 2026-02-18T01:17:19.922 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:17:19.922 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:17:19.922 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:430: TEST_divergent_2: run_mon td/divergent-priors a 2026-02-18T01:17:19.922 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-18T01:17:19.922 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:17:19.922 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:17:19.922 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:17:19.922 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-18T01:17:19.922 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-18T01:17:19.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:17:19.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:17:19.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:17:19.949 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:17:19.949 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:19.949 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:19.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:17:19.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T01:17:19.982 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:17:19.983 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:17:19.983 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:17:19.983 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:17:19.983 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:17:19.984 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:17:19.984 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:17:19.984 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:17:19.984 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:17:19.985 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:17:19.985 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:19.985 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:19.985 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-mon.a.asok 2026-02-18T01:17:19.985 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:17:19.985 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16037/ceph-mon.a.asok config get fsid 2026-02-18T01:17:20.040 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:17:20.040 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:17:20.040 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:17:20.040 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:17:20.040 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:17:20.040 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:17:20.040 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:17:20.040 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:17:20.041 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:17:20.041 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:20.041 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:20.041 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-mon.a.asok 2026-02-18T01:17:20.041 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:17:20.041 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16037/ceph-mon.a.asok config get mon_host 2026-02-18T01:17:20.094 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: run_mgr td/divergent-priors x 2026-02-18T01:17:20.094 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-18T01:17:20.095 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:17:20.095 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T01:17:20.095 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:17:20.095 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-18T01:17:20.095 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:17:20.214 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:17:20.214 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:17:20.214 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:17:20.215 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:17:20.215 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:20.215 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:20.215 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:17:20.216 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:17:20.217 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 0 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:20.236 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:17:20.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-18T01:17:20.238 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:17:20.239 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c2fc521e-bbd5-4196-a06b-8c1a91280dfc 2026-02-18T01:17:20.239 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c2fc521e-bbd5-4196-a06b-8c1a91280dfc' 2026-02-18T01:17:20.239 INFO:tasks.workunit.client.0.trial080.stdout:add osd0 c2fc521e-bbd5-4196-a06b-8c1a91280dfc 2026-02-18T01:17:20.239 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:17:20.252 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAgE5VpA0S5DhAAwtzOzGCiwSrp+nYC1wJ44w== 2026-02-18T01:17:20.252 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAgE5VpA0S5DhAAwtzOzGCiwSrp+nYC1wJ44w=="}' 2026-02-18T01:17:20.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c2fc521e-bbd5-4196-a06b-8c1a91280dfc -i td/divergent-priors/0/new.json 2026-02-18T01:17:20.367 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:17:20.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-18T01:17:20.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAgE5VpA0S5DhAAwtzOzGCiwSrp+nYC1wJ44w== --osd-uuid c2fc521e-bbd5-4196-a06b-8c1a91280dfc 2026-02-18T01:17:20.395 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:20.388+0000 7f4ccd1faa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:20.397 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:20.388+0000 7f4ccd1faa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:20.398 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:20.392+0000 7f4ccd1faa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:20.399 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:20.392+0000 7f4ccd1faa40 -1 bdev(0x5610b2f8cc00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:17:20.399 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:20.392+0000 7f4ccd1faa40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-18T01:17:21.178 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-18T01:17:21.179 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:17:21.179 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:17:21.180 INFO:tasks.workunit.client.0.trial080.stdout:adding osd0 key to auth repository 2026-02-18T01:17:21.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:17:21.303 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:17:21.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:17:21.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:17:21.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:17:21.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:17:21.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:17:21.333 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:21.324+0000 7ff5cd753a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:21.335 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:21.328+0000 7ff5cd753a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:21.336 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:21.328+0000 7ff5cd753a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:21.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:17:21.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:17:21.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:17:21.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:17:21.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:17:21.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:17:21.416 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:17:21.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:17:21.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:17:21.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:17:21.524 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:17:21.768 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:21.760+0000 7ff5cd753a40 -1 Falling back to public interface 2026-02-18T01:17:22.525 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:17:22.525 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:17:22.525 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:17:22.526 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:17:22.526 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:17:22.526 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:17:22.704 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:22.696+0000 7ff5cd753a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:17:22.734 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:17:23.736 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:17:23.736 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:17:23.736 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:17:23.736 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:17:23.737 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:17:23.737 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:17:23.944 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1528260793,v1:127.0.0.1:6801/1528260793] [v2:127.0.0.1:6802/1528260793,v1:127.0.0.1:6803/1528260793] exists,up c2fc521e-bbd5-4196-a06b-8c1a91280dfc 2026-02-18T01:17:23.947 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:17:23.947 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:17:23.947 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:17:23.947 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-18T01:17:23.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 1 2026-02-18T01:17:23.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-18T01:17:23.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:17:23.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T01:17:23.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:17:23.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-18T01:17:23.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:17:23.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:17:23.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:17:23.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:17:23.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-18T01:17:23.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:17:23.949 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:17:23.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:17:23.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:17:23.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:17:23.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:17:23.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:17:23.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:17:23.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:17:23.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:17:23.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:17:23.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-18T01:17:23.950 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:17:23.951 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=24dc2c71-9b2f-48eb-8710-5374b5af4325 2026-02-18T01:17:23.951 INFO:tasks.workunit.client.0.trial080.stdout:add osd1 24dc2c71-9b2f-48eb-8710-5374b5af4325 2026-02-18T01:17:23.952 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 24dc2c71-9b2f-48eb-8710-5374b5af4325' 2026-02-18T01:17:23.952 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:17:23.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAjE5VpWeEYORAA2DA95BMAOUvhZ6xtKYlL7w== 2026-02-18T01:17:23.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAjE5VpWeEYORAA2DA95BMAOUvhZ6xtKYlL7w=="}' 2026-02-18T01:17:23.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 24dc2c71-9b2f-48eb-8710-5374b5af4325 -i td/divergent-priors/1/new.json 2026-02-18T01:17:24.179 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:17:24.189 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-18T01:17:24.191 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAjE5VpWeEYORAA2DA95BMAOUvhZ6xtKYlL7w== --osd-uuid 24dc2c71-9b2f-48eb-8710-5374b5af4325 2026-02-18T01:17:24.209 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:24.200+0000 7f4efa9daa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:24.211 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:24.204+0000 7f4efa9daa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:24.212 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:24.204+0000 7f4efa9daa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:24.212 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:24.204+0000 7f4efa9daa40 -1 bdev(0x562410eb6c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-18T01:17:24.213 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:24.204+0000 7f4efa9daa40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-18T01:17:24.865 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-18T01:17:24.865 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:17:24.866 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T01:17:24.867 INFO:tasks.workunit.client.0.trial080.stdout:adding osd1 key to auth repository 2026-02-18T01:17:24.867 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:17:25.156 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:17:25.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T01:17:25.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:17:25.158 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:17:25.158 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:17:25.158 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:17:25.185 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:25.176+0000 7f313d24fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:25.186 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:25.176+0000 7f313d24fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:25.187 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:25.180+0000 7f313d24fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:25.372 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T01:17:25.372 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:17:25.372 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:17:25.372 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:17:25.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:17:25.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:17:25.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:17:25.373 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:17:25.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:17:25.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:17:25.584 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:17:25.640 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:25.632+0000 7f313d24fa40 -1 Falling back to public interface 2026-02-18T01:17:26.326 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:26.316+0000 7f313d24fa40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:17:26.585 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:17:26.585 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:17:26.586 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:17:26.586 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:17:26.587 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:17:26.587 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:17:26.810 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:17:27.811 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:17:27.811 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:17:27.811 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:17:27.812 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:17:27.812 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:17:27.812 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:17:28.020 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3076030162,v1:127.0.0.1:6811/3076030162] [v2:127.0.0.1:6812/3076030162,v1:127.0.0.1:6813/3076030162] exists,up 24dc2c71-9b2f-48eb-8710-5374b5af4325 2026-02-18T01:17:28.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:17:28.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:17:28.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:17:28.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-18T01:17:28.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 2 2026-02-18T01:17:28.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-18T01:17:28.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:17:28.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T01:17:28.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:17:28.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-18T01:17:28.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:17:28.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:17:28.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:17:28.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:17:28.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-18T01:17:28.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-18T01:17:28.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:17:28.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:17:28.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:17:28.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:17:28.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:17:28.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:17:28.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:17:28.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:17:28.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:17:28.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-18T01:17:28.027 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:17:28.028 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=007ddce5-6ad7-4f29-9f6a-d9b4b893c37f 2026-02-18T01:17:28.028 INFO:tasks.workunit.client.0.trial080.stdout:add osd2 007ddce5-6ad7-4f29-9f6a-d9b4b893c37f 2026-02-18T01:17:28.028 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 007ddce5-6ad7-4f29-9f6a-d9b4b893c37f' 2026-02-18T01:17:28.028 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:17:28.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAoE5VpEw4JAhAA39qVdvEimo+d64XjYdzIqw== 2026-02-18T01:17:28.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAoE5VpEw4JAhAA39qVdvEimo+d64XjYdzIqw=="}' 2026-02-18T01:17:28.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 007ddce5-6ad7-4f29-9f6a-d9b4b893c37f -i td/divergent-priors/2/new.json 2026-02-18T01:17:28.251 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:17:28.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-18T01:17:28.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAoE5VpEw4JAhAA39qVdvEimo+d64XjYdzIqw== --osd-uuid 007ddce5-6ad7-4f29-9f6a-d9b4b893c37f 2026-02-18T01:17:28.279 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:28.272+0000 7fe3c65a5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:28.281 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:28.272+0000 7fe3c65a5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:28.282 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:28.272+0000 7fe3c65a5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:28.283 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:28.276+0000 7fe3c65a5a40 -1 bdev(0x55b20380ec00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-18T01:17:28.283 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:28.276+0000 7fe3c65a5a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-18T01:17:28.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-18T01:17:28.930 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:17:28.931 INFO:tasks.workunit.client.0.trial080.stdout:adding osd2 key to auth repository 2026-02-18T01:17:28.931 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T01:17:28.931 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:17:29.214 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:17:29.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T01:17:29.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:17:29.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:17:29.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:17:29.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:17:29.242 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:29.232+0000 7f8278a4fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:29.244 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:29.236+0000 7f8278a4fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:29.245 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:29.236+0000 7f8278a4fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:29.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T01:17:29.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:17:29.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:17:29.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:17:29.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:17:29.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:17:29.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:17:29.431 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:17:29.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:17:29.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:17:29.628 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:29.620+0000 7f8278a4fa40 -1 Falling back to public interface 2026-02-18T01:17:29.646 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:17:30.289 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:30.280+0000 7f8278a4fa40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:17:30.647 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:17:30.648 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:17:30.648 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:17:30.649 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:17:30.649 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:17:30.649 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:17:30.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:17:31.864 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:17:31.864 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:17:31.864 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:17:31.865 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:17:31.865 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:17:31.865 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:17:32.076 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3009847243,v1:127.0.0.1:6819/3009847243] [v2:127.0.0.1:6820/3009847243,v1:127.0.0.1:6821/3009847243] exists,up 007ddce5-6ad7-4f29-9f6a-d9b4b893c37f 2026-02-18T01:17:32.077 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:17:32.077 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:17:32.078 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:17:32.078 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:437: TEST_divergent_2: ceph osd set noout 2026-02-18T01:17:32.371 INFO:tasks.workunit.client.0.trial080.stderr:noout is set 2026-02-18T01:17:32.383 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:438: TEST_divergent_2: ceph osd set noin 2026-02-18T01:17:32.674 INFO:tasks.workunit.client.0.trial080.stderr:noin is set 2026-02-18T01:17:32.684 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:439: TEST_divergent_2: ceph osd set nodown 2026-02-18T01:17:32.980 INFO:tasks.workunit.client.0.trial080.stderr:nodown is set 2026-02-18T01:17:32.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:440: TEST_divergent_2: create_pool test 1 1 2026-02-18T01:17:32.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-18T01:17:33.234 INFO:tasks.workunit.client.0.trial080.stderr:pool 'test' already exists 2026-02-18T01:17:33.244 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T01:17:34.245 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:441: TEST_divergent_2: ceph osd pool set test size 3 2026-02-18T01:17:34.547 INFO:tasks.workunit.client.0.trial080.stderr:set pool 1 size to 3 2026-02-18T01:17:34.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:442: TEST_divergent_2: ceph osd pool set test min_size 2 2026-02-18T01:17:34.853 INFO:tasks.workunit.client.0.trial080.stderr:set pool 1 min_size to 2 2026-02-18T01:17:34.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:444: TEST_divergent_2: flush_pg_stats 2026-02-18T01:17:34.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:17:34.863 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:17:35.069 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:17:35.069 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:17:35.069 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:17:35.070 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:17:35.070 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:17:35.070 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:17:35.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-18T01:17:35.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-18T01:17:35.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485' 2026-02-18T01:17:35.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:17:35.152 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:17:35.232 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-18T01:17:35.232 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-18T01:17:35.232 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-18T01:17:35.232 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:17:35.232 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:17:35.316 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-18T01:17:35.316 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-18T01:17:35.316 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-55834574851' 2026-02-18T01:17:35.316 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:17:35.317 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-18T01:17:35.317 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:17:35.318 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:17:35.319 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836485 2026-02-18T01:17:35.319 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:17:35.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836485 2026-02-18T01:17:35.320 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836485 2026-02-18T01:17:35.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-18T01:17:35.321 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:17:35.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-18T01:17:35.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:17:36.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:17:36.536 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:17:36.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-18T01:17:36.746 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:17:36.746 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-18T01:17:36.746 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:17:36.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:17:36.748 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705668 2026-02-18T01:17:36.748 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:17:36.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705668 2026-02-18T01:17:36.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-18T01:17:36.750 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 38654705668 2026-02-18T01:17:36.750 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:17:36.972 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-18T01:17:36.972 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:17:36.972 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-18T01:17:36.973 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:17:36.973 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:17:36.974 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574851 2026-02-18T01:17:36.974 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:17:36.976 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574851 2026-02-18T01:17:36.976 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-18T01:17:36.976 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 55834574851 2026-02-18T01:17:36.976 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:17:37.200 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574852 -lt 55834574851 2026-02-18T01:17:37.200 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:445: TEST_divergent_2: wait_for_clean 2026-02-18T01:17:37.201 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:17:37.201 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:17:37.201 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:17:37.201 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:17:37.202 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:17:37.202 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:17:37.202 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:17:37.202 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:17:37.202 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:17:37.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:17:37.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:17:37.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:17:37.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:17:37.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:17:37.309 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:17:37.516 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:17:37.516 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:17:37.516 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:17:37.516 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:17:37.516 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:17:37.517 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:17:37.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-18T01:17:37.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-18T01:17:37.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-18T01:17:37.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:17:37.599 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:17:37.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705671 2026-02-18T01:17:37.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705671 2026-02-18T01:17:37.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705671' 2026-02-18T01:17:37.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:17:37.679 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:17:37.758 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-18T01:17:37.759 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-18T01:17:37.759 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705671 2-55834574854' 2026-02-18T01:17:37.759 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:17:37.759 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-18T01:17:37.760 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:17:37.760 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:17:37.761 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-18T01:17:37.761 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:17:37.762 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-18T01:17:37.762 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836487 2026-02-18T01:17:37.763 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-18T01:17:37.763 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:17:37.989 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-18T01:17:37.989 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:17:38.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:17:38.990 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:17:39.203 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-18T01:17:39.203 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:17:39.204 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705671 2026-02-18T01:17:39.204 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:17:39.205 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:17:39.206 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705671 2026-02-18T01:17:39.206 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:17:39.207 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705671 2026-02-18T01:17:39.207 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705671' 2026-02-18T01:17:39.208 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 38654705671 2026-02-18T01:17:39.208 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:17:39.421 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705671 -lt 38654705671 2026-02-18T01:17:39.421 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:17:39.422 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-18T01:17:39.422 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:17:39.423 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:17:39.424 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574854 2026-02-18T01:17:39.424 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:17:39.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574854 2026-02-18T01:17:39.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-18T01:17:39.426 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 55834574854 2026-02-18T01:17:39.426 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:17:39.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-18T01:17:39.645 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:17:39.645 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:17:39.646 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:17:39.928 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:17:39.928 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:17:39.928 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:17:39.928 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:17:39.928 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:17:39.928 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:17:39.928 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:17:39.929 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:17:40.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-18T01:17:40.139 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:17:40.139 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:17:40.139 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:17:40.427 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-18T01:17:40.427 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:17:40.427 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:17:40.428 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: ceph pg dump pgs --format=json 2026-02-18T01:17:40.428 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: jq '.pg_stats[0].up_primary' 2026-02-18T01:17:40.621 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:17:40.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: local divergent=1 2026-02-18T01:17:40.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:449: TEST_divergent_2: echo 'primary and soon to be divergent is 1' 2026-02-18T01:17:40.633 INFO:tasks.workunit.client.0.trial080.stdout:primary and soon to be divergent is 1 2026-02-18T01:17:40.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:450: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:17:40.837 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:17:40.837 INFO:tasks.workunit.client.0.trial080.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T01:17:33.925800+0000 0'0 26:22 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:53:55.882924+0000 0 0 2026-02-18T01:17:40.837 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:17:40.837 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:17:40.838 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:17:40.846 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: local non_divergent= 2026-02-18T01:17:40.847 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-18T01:17:40.847 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 0 = 1 ']' 2026-02-18T01:17:40.847 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0' 2026-02-18T01:17:40.847 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-18T01:17:40.847 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 1 = 1 ']' 2026-02-18T01:17:40.847 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:455: TEST_divergent_2: continue 2026-02-18T01:17:40.847 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-18T01:17:40.847 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 2 = 1 ']' 2026-02-18T01:17:40.847 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0 2' 2026-02-18T01:17:40.847 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:460: TEST_divergent_2: echo 'writing initial objects' 2026-02-18T01:17:40.848 INFO:tasks.workunit.client.0.trial080.stdout:writing initial objects 2026-02-18T01:17:40.848 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: seq 1 100 2026-02-18T01:17:40.848 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:40.849 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:40.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:40.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:40.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:40.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_3 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:40.924 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:40.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:40.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:40.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_5 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:40.976 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:40.976 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_6 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_7 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_8 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_9 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_10 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.116 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.116 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_11 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_12 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.172 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.173 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_13 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.200 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.200 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_14 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.228 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.228 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_15 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.252 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_16 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.280 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.280 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_17 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.309 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_18 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_19 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.365 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.365 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_20 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.392 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.392 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_21 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.420 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.420 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_22 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.440 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.440 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_23 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_24 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.493 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.493 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_25 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_26 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.548 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.548 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_27 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_28 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.603 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.603 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_29 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_30 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.660 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.660 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_31 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.687 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.688 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_32 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.715 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.715 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_33 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_34 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.767 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.768 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_35 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.796 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.796 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_36 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.824 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.826 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_37 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_38 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.881 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.881 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_39 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.908 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.908 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_40 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_41 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_42 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:41.992 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:41.992 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_43 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_44 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.048 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.048 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_45 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.075 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.076 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_46 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.104 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.104 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_47 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.132 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.132 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_48 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_49 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.185 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.185 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_50 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.213 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.213 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_51 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_52 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.268 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.268 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_53 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.292 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.292 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_54 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.312 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.312 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_55 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.339 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.339 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_56 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.365 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.365 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_57 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.393 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.393 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_58 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.420 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.420 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_59 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.448 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.448 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_60 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_61 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.504 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_62 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_63 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_64 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.578 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.578 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_65 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_66 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_67 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.661 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.661 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_68 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.688 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.688 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_69 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.716 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.716 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_70 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_71 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.772 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.772 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_72 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_73 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_74 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.856 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.856 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_75 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_76 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_77 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.940 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.941 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_78 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.967 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.967 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_79 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:42.996 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:42.996 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_80 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_81 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.051 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.051 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_82 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.079 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.079 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_83 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.107 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.107 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_84 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_85 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.164 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.164 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_86 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.192 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.192 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_87 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.220 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.220 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_88 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_89 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_90 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_91 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.333 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.333 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_92 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.361 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.361 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_93 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.389 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.389 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_94 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_95 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_96 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.456 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.456 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_97 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.483 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.483 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_98 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.509 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.509 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_99 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-18T01:17:43.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_100 /tmp/tmp.j4BqkTY94A 2026-02-18T01:17:43.565 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-18T01:17:43.565 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: wait_for_clean 2026-02-18T01:17:43.565 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:17:43.565 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:17:43.565 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:17:43.566 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-18T01:17:43.566 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:17:43.567 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:17:43.567 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:17:43.567 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:17:43.567 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:17:43.628 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-18T01:17:43.628 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:17:43.628 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:17:43.628 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:17:43.628 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:17:43.628 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:17:43.840 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:17:43.840 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:17:43.840 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:17:43.840 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:17:43.840 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:17:43.841 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:17:43.922 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-18T01:17:43.922 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-18T01:17:43.922 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491' 2026-02-18T01:17:43.923 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:17:43.923 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:17:44.006 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-18T01:17:44.006 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-18T01:17:44.006 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-18T01:17:44.007 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:17:44.007 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:17:44.087 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-18T01:17:44.087 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-18T01:17:44.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574857' 2026-02-18T01:17:44.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:17:44.088 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-18T01:17:44.089 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:17:44.090 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:17:44.091 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836491 2026-02-18T01:17:44.091 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:17:44.092 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836491 2026-02-18T01:17:44.092 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836491 2026-02-18T01:17:44.093 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-18T01:17:44.093 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:17:44.311 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836491 2026-02-18T01:17:44.311 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:17:45.313 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:17:45.313 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:17:45.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-18T01:17:45.531 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:17:45.531 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-18T01:17:45.531 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:17:45.533 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:17:45.534 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705674 2026-02-18T01:17:45.534 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:17:45.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705674 2026-02-18T01:17:45.535 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 38654705674 2026-02-18T01:17:45.536 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-18T01:17:45.536 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:17:45.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-18T01:17:45.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:17:45.749 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-18T01:17:45.749 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:17:45.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:17:45.751 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574857 2026-02-18T01:17:45.751 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:17:45.753 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574857 2026-02-18T01:17:45.753 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 55834574857 2026-02-18T01:17:45.754 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-18T01:17:45.754 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:17:45.972 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-18T01:17:45.972 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:17:45.973 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:17:45.973 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:17:46.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:17:46.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:17:46.256 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:17:46.256 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:17:46.256 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:17:46.256 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:17:46.256 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:17:46.256 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:17:46.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-18T01:17:46.469 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:17:46.469 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:17:46.469 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:17:46.757 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-18T01:17:46.757 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:17:46.757 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:17:46.758 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: get_pg test existing_1 2026-02-18T01:17:46.758 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-18T01:17:46.758 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-18T01:17:46.758 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-18T01:17:46.758 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-18T01:17:46.977 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: local pgid=1.0 2026-02-18T01:17:46.977 INFO:tasks.workunit.client.0.trial080.stdout:blackholing osds 0 2 2026-02-18T01:17:46.977 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:472: TEST_divergent_2: echo 'blackholing osds 0 2' 2026-02-18T01:17:46.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:17:47.179 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:17:47.179 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-18T01:17:33.925800+0000 29'100 29:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:53:55.882924+0000 0 0 2026-02-18T01:17:47.179 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:17:47.179 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:17:47.180 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:17:47.188 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-18T01:17:47.189 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.0 2026-02-18T01:17:47.189 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T01:17:47.189 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T01:17:47.189 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:17:47.189 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:47.189 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:47.190 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.0.asok 2026-02-18T01:17:47.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-18T01:17:47.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-18T01:17:47.242 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:17:47.242 INFO:tasks.workunit.client.0.trial080.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-18T01:17:47.242 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:17:47.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-18T01:17:47.248 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.2 2026-02-18T01:17:47.248 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-18T01:17:47.248 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-18T01:17:47.249 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:17:47.249 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:47.250 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:47.250 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.2.asok 2026-02-18T01:17:47.250 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-18T01:17:47.250 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-18T01:17:47.300 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:17:47.300 INFO:tasks.workunit.client.0.trial080.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-18T01:17:47.301 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:17:47.306 INFO:tasks.workunit.client.0.trial080.stdout:create new divergent objects 2026-02-18T01:17:47.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: echo 'create new divergent objects' 2026-02-18T01:17:47.307 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: seq 1 2 2026-02-18T01:17:47.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-18T01:17:47.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-18T01:17:47.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_1 2026-02-18T01:17:47.308 INFO:tasks.workunit.client.0.trial080.stdout:writing divergent objects 2026-02-18T01:17:47.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: echo 'writing divergent objects' 2026-02-18T01:17:47.309 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_2 2026-02-18T01:17:47.309 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: seq 1 2 2026-02-18T01:17:47.309 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-18T01:17:47.309 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-18T01:17:47.309 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.ea5sWwt2qu 2026-02-18T01:17:47.310 INFO:tasks.workunit.client.0.trial080.stdout:remove divergent objects 2026-02-18T01:17:47.310 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: echo 'remove divergent objects' 2026-02-18T01:17:47.310 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.ea5sWwt2qu 2026-02-18T01:17:47.310 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: seq 1 2 2026-02-18T01:17:47.311 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-18T01:17:47.311 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 1 + 2 2026-02-18T01:17:47.313 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=3 2026-02-18T01:17:47.313 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-18T01:17:47.313 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_3 2026-02-18T01:17:47.313 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 2 + 2 2026-02-18T01:17:47.315 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=4 2026-02-18T01:17:47.315 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:498: TEST_divergent_2: sleep 10 2026-02-18T01:17:47.315 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_4 2026-02-18T01:17:57.317 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:499: TEST_divergent_2: killall -9 rados 2026-02-18T01:17:57.371 INFO:tasks.workunit.client.0.trial080.stderr:rados: no process found 2026-02-18T01:17:57.372 INFO:tasks.workunit.client.0.trial080.stdout:killing all the osds 2026-02-18T01:17:57.372 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:502: TEST_divergent_2: echo 'killing all the osds' 2026-02-18T01:17:57.372 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:503: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:17:57.582 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:17:57.583 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-18T01:17:33.925800+0000 29'106 29:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:53:55.882924+0000 0 0 2026-02-18T01:17:57.583 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:17:57.583 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:17:57.583 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:17:57.591 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd 2026-02-18T01:17:57.592 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:17:57.592 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:17:57.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:17:57.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:17:57.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:17:57.701 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:17:57.701 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-18T01:17:57.701 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.0 2026-02-18T01:17:57.963 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already down. 2026-02-18T01:17:57.972 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-18T01:17:57.972 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.1 2026-02-18T01:17:58.253 INFO:tasks.workunit.client.0.trial080.stderr:osd.1 is already down. 2026-02-18T01:17:58.262 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-18T01:17:58.262 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.2 2026-02-18T01:17:58.540 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already down. 2026-02-18T01:17:58.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-18T01:17:58.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.0 2026-02-18T01:17:58.829 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already out. 2026-02-18T01:17:58.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-18T01:17:58.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.2 2026-02-18T01:17:59.113 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already out. 2026-02-18T01:17:59.122 INFO:tasks.workunit.client.0.trial080.stdout:bringing up non_divergent 0 2 2026-02-18T01:17:59.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:515: TEST_divergent_2: echo 'bringing up non_divergent 0 2' 2026-02-18T01:17:59.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:17:59.337 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:17:59.337 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-18T01:17:33.925800+0000 29'106 29:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:53:55.882924+0000 0 0 2026-02-18T01:17:59.337 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:17:59.337 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:17:59.337 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:17:59.348 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-18T01:17:59.348 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 0 2026-02-18T01:17:59.348 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:17:59.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:17:59.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:17:59.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:17:59.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-18T01:17:59.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:17:59.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:17:59.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:17:59.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:17:59.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-18T01:17:59.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-18T01:17:59.350 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:17:59.350 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:17:59.350 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:17:59.350 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:17:59.350 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:17:59.350 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:17:59.350 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:17:59.350 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:17:59.350 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:17:59.350 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:17:59.350 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:17:59.350 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:17:59.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:17:59.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:17:59.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:17:59.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:17:59.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:17:59.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:17:59.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:17:59.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:17:59.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-18T01:17:59.352 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:17:59.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:17:59.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:17:59.353 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-18T01:17:59.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:17:59.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:17:59.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:17:59.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:17:59.375 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:59.368+0000 7f7d8bcb5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:59.377 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:59.368+0000 7f7d8bcb5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:59.377 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:59.368+0000 7f7d8bcb5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:17:59.569 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:17:59.569 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:17:59.569 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:17:59.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:17:59.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:17:59.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:17:59.570 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:17:59.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:17:59.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:17:59.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:17:59.784 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:17:59.776+0000 7f7d8bcb5a40 -1 Falling back to public interface 2026-02-18T01:17:59.786 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:18:00.499 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:18:00.492+0000 7f7d8bcb5a40 -1 osd.0 29 log_to_monitors true 2026-02-18T01:18:00.787 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:18:00.787 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:18:00.788 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:18:00.788 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:18:00.788 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:18:00.789 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:18:01.005 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6800/6869586,v1:127.0.0.1:6801/6869586] [v2:127.0.0.1:6802/6869586,v1:127.0.0.1:6803/6869586] exists,up c2fc521e-bbd5-4196-a06b-8c1a91280dfc 2026-02-18T01:18:01.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:18:01.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:18:01.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:18:01.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-18T01:18:01.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 2 2026-02-18T01:18:01.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:18:01.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:18:01.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T01:18:01.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:18:01.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-18T01:18:01.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:18:01.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:18:01.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:18:01.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:18:01.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-18T01:18:01.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-18T01:18:01.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:18:01.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:18:01.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:18:01.010 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:18:01.010 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:18:01.010 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:18:01.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:18:01.012 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-18T01:18:01.012 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:18:01.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T01:18:01.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:18:01.013 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-18T01:18:01.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T01:18:01.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:18:01.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:18:01.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:18:01.030 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:18:01.020+0000 7f586031aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:18:01.031 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:18:01.024+0000 7f586031aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:18:01.032 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:18:01.024+0000 7f586031aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:18:01.221 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T01:18:01.221 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:18:01.222 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:18:01.222 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:18:01.222 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:18:01.222 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:18:01.222 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:18:01.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:18:01.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:18:01.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:18:01.434 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:18:01.488 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:18:01.480+0000 7f586031aa40 -1 Falling back to public interface 2026-02-18T01:18:02.185 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:18:02.176+0000 7f586031aa40 -1 osd.2 29 log_to_monitors true 2026-02-18T01:18:02.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:18:02.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:18:02.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:18:02.437 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:18:02.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:18:02.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:18:02.651 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 32 last_clean_interval [13,29) [v2:127.0.0.1:6810/1962413313,v1:127.0.0.1:6811/1962413313] [v2:127.0.0.1:6812/1962413313,v1:127.0.0.1:6813/1962413313] exists,up 007ddce5-6ad7-4f29-9f6a-d9b4b893c37f 2026-02-18T01:18:02.652 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:18:02.652 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:18:02.652 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:18:02.652 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-18T01:18:02.652 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.0 2026-02-18T01:18:02.918 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already in. 2026-02-18T01:18:02.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-18T01:18:02.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.2 2026-02-18T01:18:03.207 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already in. 2026-02-18T01:18:03.217 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-18T01:18:03.217 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: wait_for_clean 2026-02-18T01:18:03.217 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:18:03.218 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:18:03.218 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:18:03.218 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-18T01:18:03.219 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:18:03.219 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:18:03.219 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:18:03.219 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:18:03.219 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:18:03.283 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-18T01:18:03.283 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:18:03.283 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:18:03.283 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:18:03.283 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:18:03.283 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:18:03.500 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:18:03.500 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:18:03.500 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:18:03.500 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:18:03.500 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:18:03.501 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:18:03.582 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-18T01:18:03.582 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-18T01:18:03.582 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-154618822659' 2026-02-18T01:18:03.582 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:18:03.583 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:18:03.641 INFO:tasks.workunit.client.0.trial080.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-18T01:18:03.643 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-18T01:18:03.643 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-18T01:18:03.643 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-18T01:18:03.643 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:18:03.644 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:18:03.724 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-18T01:18:03.724 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-18T01:18:03.724 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-154618822659 2-163208757251' 2026-02-18T01:18:03.724 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:18:03.725 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822659 2026-02-18T01:18:03.725 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:18:03.726 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:18:03.727 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-154618822659 2026-02-18T01:18:03.727 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:18:03.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822659 2026-02-18T01:18:03.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 154618822659' 2026-02-18T01:18:03.729 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 154618822659 2026-02-18T01:18:03.729 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:18:03.956 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 154618822659 2026-02-18T01:18:03.956 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:18:04.957 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:18:04.958 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:18:05.174 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-18T01:18:05.174 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:18:05.175 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757251 2026-02-18T01:18:05.175 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:18:05.176 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:18:05.177 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-163208757251 2026-02-18T01:18:05.177 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:18:05.178 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757251 2026-02-18T01:18:05.179 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-18T01:18:05.179 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 163208757251 2026-02-18T01:18:05.179 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:18:05.394 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-18T01:18:05.394 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:18:05.395 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:05.395 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:05.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:18:05.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:05.677 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:05.677 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:05.677 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:05.678 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:05.678 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:05.678 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:05.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:05.882 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:05.883 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:05.883 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:06.159 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:06.159 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-18T01:18:06.159 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-18T01:18:06.159 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-18T01:18:06.159 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:06.159 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-18T01:18:06.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:06.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:06.261 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:06.261 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:06.261 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:06.261 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:06.261 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:06.261 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:06.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:06.468 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:06.469 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:06.469 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:06.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:06.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:06.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:06.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:06.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:06.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:06.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:06.744 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:06.745 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:07.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:07.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:07.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-18T01:18:07.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:07.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-18T01:18:07.222 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:07.222 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:07.223 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:07.223 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:07.224 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:07.224 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:07.224 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:07.224 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:07.432 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:07.433 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:07.433 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:07.433 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:07.714 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:07.714 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:07.714 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:07.715 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:07.715 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:07.715 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:07.715 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:07.715 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:07.715 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:08.000 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:08.000 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:08.000 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-18T01:18:08.001 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:08.001 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-18T01:18:08.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:08.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:08.402 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:08.402 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:08.402 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:08.403 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:08.403 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:08.403 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:08.613 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:08.614 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:08.614 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:08.614 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:08.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:08.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:08.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:08.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:08.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:08.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:08.905 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:08.905 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:08.905 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:09.192 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:09.192 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:09.192 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-18T01:18:09.192 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:09.192 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-18T01:18:09.992 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:09.993 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:09.994 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:09.994 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:09.994 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:09.994 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:09.994 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:09.994 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:10.209 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:10.210 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:10.210 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:10.210 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:10.489 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:10.490 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:10.490 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:10.490 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:10.490 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:10.490 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:10.490 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:10.491 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:10.491 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:10.773 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:10.773 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:10.773 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-18T01:18:10.773 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:10.773 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-18T01:18:12.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:12.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:12.375 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:12.375 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:12.375 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:12.375 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:12.375 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:12.375 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:12.581 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:12.581 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:12.582 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:12.582 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:12.857 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:12.857 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:12.857 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:12.857 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:12.857 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:12.858 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:12.858 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:12.858 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:12.858 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:13.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:13.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:13.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-18T01:18:13.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:13.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-18T01:18:16.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:16.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:16.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:16.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:16.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:16.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:16.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:16.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:16.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:16.556 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:16.556 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:16.556 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:16.844 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:16.844 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:16.845 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:16.845 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:16.845 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:16.845 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:16.845 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:16.845 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:16.846 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:17.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:17.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:17.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-18T01:18:17.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:17.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-18T01:18:23.527 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:23.527 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:23.528 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:23.528 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:23.528 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:23.528 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:23.528 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:23.529 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:23.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:23.742 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:23.742 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:23.742 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:24.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:24.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:24.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:24.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:24.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:24.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:24.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:24.025 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:24.025 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:24.311 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:24.312 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:24.312 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-18T01:18:24.312 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:24.312 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-18T01:18:31.613 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:31.613 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:31.614 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:31.614 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:31.614 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:31.614 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:31.614 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:31.614 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:31.823 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:31.823 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:31.824 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:31.824 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:32.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:32.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:32.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:32.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:32.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:32.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:32.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:32.113 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:32.113 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:32.397 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:32.397 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:32.397 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-18T01:18:32.397 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_fingerprint": "e88847b4-c5f7-4665-b9c6-c04a0711b2bb", 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "version": "20.2.0-670-gadc19233", 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "commit": "adc1923395f2bcd6ae89b5d331d278364d1848ed", 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "timestamp": "2026-02-18T01:18:32.665214+0000", 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "tag": "", 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "health": { 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "status": "HEALTH_WARN", 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "checks": { 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "OSDMAP_FLAGS": { 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-18T01:18:32.670 INFO:tasks.workunit.client.0.trial080.stdout: "count": 17 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [], 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "OSD_DOWN": { 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "message": "1 osds down", 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "count": 1 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "message": "osd.1 (root=default,host=trial080) is down" 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "PG_DEGRADED": { 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "count": 1 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "mutes": [] 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_first_committed": 1, 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_last_committed": 1, 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "monmap": { 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:17:19.937166Z", 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:17:19.937166Z", 2026-02-18T01:18:32.671 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release": 20, 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release_name": "tentacle", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "election_strategy": 1, 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "disallowed_leaders": "", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": false, 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "tiebreaker_mon": "", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "removed_ranks": "", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "features": { 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "persistent": [ 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "kraken", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "luminous", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "mimic", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap-prune", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "nautilus", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "octopus", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "pacific", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "elector-pinging", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "quincy", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "reef", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "squid", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "tentacle", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "nvmeof_beacon_diff" 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "optional": [] 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "mons": [ 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "rank": 0, 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "name": "a", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 0 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115/0", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "priority": 0, 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 0, 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "crush_location": "{}" 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.672 INFO:tasks.workunit.client.0.trial080.stdout: "quorum": [ 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: 0 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap": { 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 41, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:17:19.997728+0000", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:18:03.247081+0000", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "last_up_change": "2026-02-18T01:18:02.336442+0000", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "last_in_change": "2026-02-18T01:18:03.144841+0000", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "flags_num": 5800384, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "flags_set": [ 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "nodown", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "noin", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "noout", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "pglog_hardlimit", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snapdirs", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "recovery_deletes", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "sortbitwise" 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "crush_version": 9, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "full_ratio": 0.99000000953674316, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_snapshot": "", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "pool_max": 1, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "max_osd": 3, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "require_min_compat_client": "luminous", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "min_compat_client": "jewel", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "require_osd_release": "tentacle", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "allow_crimson": false, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "pools": [ 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "pool_name": "test", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "create_time": "2026-02-18T01:17:33.153347+0000", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "flags": 1, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "flags_names": "hashpspool", 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "type": 1, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "size": 3, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "min_size": 2, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "crush_rule": 0, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_count": 0, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_target": 0, 2026-02-18T01:18:32.673 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_barrier": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "is_stretch_pool": false, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "object_hash": 2, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "pg_autoscale_mode": "off", 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num": 1, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num": 1, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num_target": 1, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_target": 1, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_pending": 1, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "last_pg_merge_meta": { 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "source_pgid": "0.0", 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "ready_epoch": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_started": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "source_version": "0'0", 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "target_version": "0'0" 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "last_change": "26", 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend": "0", 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_preluminous": "0", 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "auid": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "snap_mode": "selfmanaged", 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "snap_seq": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "snap_epoch": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "pool_snaps": [], 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps": "[]", 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_bytes": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_objects": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "tiers": [], 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "tier_of": -1, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "read_tier": -1, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "write_tier": -1, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "cache_mode": "none", 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_bytes": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_objects": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_flush_age": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_evict_age": 0, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profile": "", 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_params": { 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "type": "none" 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.674 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_period": 0, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_count": 0, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "use_gmt_hitset": true, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "min_read_recency_for_promote": 0, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "min_write_recency_for_promote": 0, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_grade_decay_rate": 0, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_search_last_n": 0, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "grade_table": [], 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "stripe_width": 0, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "expected_num_objects": 0, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "fast_read": false, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "nonprimary_shards": "{}", 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "options": {}, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "application_metadata": {}, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "read_balance": { 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "score_type": "Fair distribution", 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "score_acting": 2.9900000095367432, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "score_stable": 2.9900000095367432, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "optimal_score": 0.67000001668930054, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "raw_score_acting": 2, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "raw_score_stable": 2, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity_weighted": 1, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "average_primary_affinity": 1, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "average_primary_affinity_weighted": 1 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "osds": [ 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "c2fc521e-bbd5-4196-a06b-8c1a91280dfc", 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 5, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 29, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 36, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 40, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 30, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.675 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6800", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6801", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6802", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6803", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6806", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6807", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6804", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:18:32.676 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6805", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6801/6869586", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6803/6869586", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6807/6869586", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6805/6869586", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "24dc2c71-9b2f-48eb-8710-5374b5af4325", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "up": 0, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 0, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 0, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 9, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 20, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 31, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.677 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/3076030162", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/3076030162", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3076030162", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3076030162", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "exists" 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "007ddce5-6ad7-4f29-9f6a-d9b4b893c37f", 2026-02-18T01:18:32.678 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 13, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 29, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 38, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 0, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 32, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:18:32.679 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/1962413313", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/1962413313", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1962413313", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1962413313", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "osd_xinfo": [ 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:17:57.902132+0000", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:17:23.685005+0000", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:17:58.191200+0000", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:17:27.294418+0000", 2026-02-18T01:18:32.680 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:17:58.479472+0000", 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:17:31.298900+0000", 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap": [], 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_items": [], 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_primaries": [], 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "pg_temp": [], 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "primary_temp": [], 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "blocklist": {}, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "range_blocklist": {}, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profiles": { 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "default": { 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "k": "2", 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "m": "2", 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "plugin": "isa", 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "technique": "reed_sol_van" 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps_queue": [], 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "new_removed_snaps": [], 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "new_purged_snaps": [], 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "crush_node_flags": {}, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "device_class_flags": {}, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": { 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_enabled": false, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_bucket_count": 0, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "degraded_stretch_mode": 0, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "recovering_stretch_mode": 0, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_bucket": 0 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "osd_metadata": [ 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6802/6869586,v1:127.0.0.1:6803/6869586]", 2026-02-18T01:18:32.681 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:17:21.004332Z", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6800/6869586,v1:127.0.0.1:6801/6869586]", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/6869586,v1:127.0.0.1:6807/6869586]", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/6869586,v1:127.0.0.1:6805/6869586]", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:18:32.682 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/0", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/3076030162,v1:127.0.0.1:6813/3076030162]", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:17:24.744972Z", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/3076030162,v1:127.0.0.1:6811/3076030162]", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3076030162,v1:127.0.0.1:6817/3076030162]", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3076030162,v1:127.0.0.1:6815/3076030162]", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:18:32.683 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/1", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/1962413313,v1:127.0.0.1:6813/1962413313]", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:17:28.794248Z", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:18:32.684 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/1962413313,v1:127.0.0.1:6811/1962413313]", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1962413313,v1:127.0.0.1:6817/1962413313]", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1962413313,v1:127.0.0.1:6815/1962413313]", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/2", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_clean_epochs": { 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "min_last_epoch_clean": 24, 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": { 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "per_pool": [ 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": 1, 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "floor": 24 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "osd_epochs": [ 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 36 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 40 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_first_committed": 1, 2026-02-18T01:18:32.685 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_last_committed": 41, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "crushmap": { 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "devices": [ 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.0", 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.1", 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.2", 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "types": [ 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 0, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd" 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "name": "host" 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 2, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "name": "chassis" 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 3, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "name": "rack" 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 4, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "name": "row" 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 5, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pdu" 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 6, 2026-02-18T01:18:32.686 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pod" 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 7, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "name": "room" 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 8, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "name": "datacenter" 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 9, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "name": "zone" 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 10, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "name": "region" 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "name": "root" 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "buckets": [ 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "id": -1, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default", 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "id": -2, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default~ssd", 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:18:32.687 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080", 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080~ssd", 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.688 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "rules": [ 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "rule_id": 0, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "rule_name": "replicated_rule", 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "type": 1, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "steps": [ 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "op": "take", 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "item": -1, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "item_name": "default" 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "op": "choose_firstn", 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "num": 0, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "type": "osd" 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "op": "emit" 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "tunables": { 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_tries": 0, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_fallback_tries": 0, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "choose_total_tries": 50, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_descend_once": 1, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_vary_r": 1, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_stable": 1, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "msr_descents": 100, 2026-02-18T01:18:32.689 INFO:tasks.workunit.client.0.trial080.stdout: "msr_collision_tries": 100, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "straw_calc_version": 1, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "allowed_bucket_algs": 54, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "profile": "jewel", 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "optimal_tunables": 1, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "legacy_tunables": 0, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "minimum_required_version": "jewel", 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables": 1, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables2": 1, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "has_v2_rules": 0, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables3": 1, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "has_v3_rules": 0, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "has_v4_buckets": 1, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables5": 1, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "has_v5_rules": 0, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "has_msr_rules": 0 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stderr:report 3370974464 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "choose_args": {} 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "fsmap": { 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "btime": "2026-02-18T01:17:19:997570+0000", 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "default_fscid": -1, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "compat": { 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "compat": {}, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "ro_compat": {}, 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "incompat": { 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "feature_1": "base v0.20", 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "feature_2": "client writeable ranges", 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "feature_3": "default file layouts on dirs", 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "feature_4": "dir inode in separate object", 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "feature_5": "mds uses versioned encoding", 2026-02-18T01:18:32.690 INFO:tasks.workunit.client.0.trial080.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "feature_8": "no anchor table", 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "feature_9": "file layout v2", 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "feature_10": "snaprealm v2", 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "feature_11": "minor log segments", 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "feature_12": "quiesce subvolumes" 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "feature_flags": { 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "enable_multiple": true, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "ever_enabled_multiple": true 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "standbys": [], 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "filesystems": [] 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_first_committed": 1, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_last_committed": 1, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "auth": { 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 5, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_secrets": 3 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 1, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_active": 1, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_unknown": 0, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_osd": 3, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "pool_sum": { 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 51200, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 100, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 0, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 300, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 100, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 100, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 100, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 100, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:18:32.691 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 16, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 16, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "up": 2, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 2, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 0 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum": { 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 3, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:18:32.692 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 83888, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2104, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 22, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 81705, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314488912, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322036645888, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2154496, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 434947, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 23448, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 83666024 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 0, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum_by_class": { 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "ssd": { 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 3, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:18:32.693 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 83888, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2104, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 22, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 81705, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314488912, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322036645888, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2154496, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 434947, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 23448, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 83666024 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "pool_stats": [ 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": 1, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 1, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 51200, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 100, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 300, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:18:32.694 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 100, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 100, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 100, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 100, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 1220608, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 153552, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.695 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 16, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 16, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "up": 2, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 2, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 3 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "osd_stats": [ 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 154618822665 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 38654705677 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 163208757257 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_state": [ 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "state": "active+undersized+degraded", 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "num": 1 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "pool_pg_unavailable_map": [ 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": "1", 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "pgs": [] 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_osd": [ 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 1, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 1, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 1, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.696 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 0, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": [ 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": {} 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "servicemap": { 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 3, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:18:28.482554+0000", 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "services": { 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "osd": { 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "daemons": { 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "summary": "", 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "0": { 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "start_epoch": 0, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "start_stamp": "0.000000", 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "gid": 0, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "metadata": {}, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "task_status": {} 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "2": { 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "start_epoch": 0, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "start_stamp": "0.000000", 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "gid": 0, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "metadata": {}, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "task_status": {} 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_first_committed": 1, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_last_committed": 37, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "logm_first_committed": 1, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "logm_last_committed": 221, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "paxos": { 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 308, 2026-02-18T01:18:32.697 INFO:tasks.workunit.client.0.trial080.stdout: "last_pn": 0, 2026-02-18T01:18:32.698 INFO:tasks.workunit.client.0.trial080.stdout: "accepted_pn": 0 2026-02-18T01:18:32.698 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:18:32.698 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:18:32.698 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-18T01:18:32.698 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: expr 2 + 2 2026-02-18T01:18:32.698 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: objname=existing_4 2026-02-18T01:18:32.698 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:530: TEST_divergent_2: echo 'writing non-divergent object existing_4' 2026-02-18T01:18:32.698 INFO:tasks.workunit.client.0.trial080.stdout:writing non-divergent object existing_4 2026-02-18T01:18:32.698 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:531: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:18:32.888 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:18:32.889 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:18:03.250343+0000 29'100 41:134 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 periodic scrub scheduled @ 2026-02-19T12:44:07.695895+0000 0 0 2026-02-18T01:18:32.889 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:18:32.889 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:18:32.889 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:18:32.897 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:532: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.ea5sWwt2qu 2026-02-18T01:18:32.928 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: rm -f /tmp/tmp.ea5sWwt2qu 2026-02-18T01:18:32.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-18T01:18:32.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: wait_for_clean 2026-02-18T01:18:32.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:18:32.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:18:32.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:18:32.930 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-18T01:18:32.930 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:18:32.930 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:18:32.931 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:18:32.931 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:18:32.931 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:18:33.002 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-18T01:18:33.003 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:18:33.003 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:18:33.003 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:18:33.003 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:18:33.003 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:18:33.214 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:18:33.214 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:18:33.214 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:18:33.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:18:33.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:18:33.215 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:18:33.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822667 2026-02-18T01:18:33.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822667 2026-02-18T01:18:33.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-154618822667' 2026-02-18T01:18:33.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:18:33.296 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:18:33.357 INFO:tasks.workunit.client.0.trial080.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-18T01:18:33.361 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-18T01:18:33.361 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-18T01:18:33.361 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-18T01:18:33.361 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:18:33.361 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:18:33.438 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757259 2026-02-18T01:18:33.438 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757259 2026-02-18T01:18:33.438 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-154618822667 2-163208757259' 2026-02-18T01:18:33.438 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:18:33.439 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822667 2026-02-18T01:18:33.439 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:18:33.440 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:18:33.440 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-154618822667 2026-02-18T01:18:33.441 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:18:33.442 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822667 2026-02-18T01:18:33.442 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 154618822667 2026-02-18T01:18:33.443 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 154618822667' 2026-02-18T01:18:33.443 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:18:33.672 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822665 -lt 154618822667 2026-02-18T01:18:33.672 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:18:34.673 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:18:34.674 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:18:34.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822667 -lt 154618822667 2026-02-18T01:18:34.892 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:18:34.892 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757259 2026-02-18T01:18:34.892 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:18:34.893 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:18:34.894 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-163208757259 2026-02-18T01:18:34.894 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:18:34.896 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757259 2026-02-18T01:18:34.896 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 163208757259' 2026-02-18T01:18:34.896 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 163208757259 2026-02-18T01:18:34.896 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:18:35.113 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757259 -lt 163208757259 2026-02-18T01:18:35.114 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:18:35.114 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:35.114 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:35.424 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:18:35.424 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:35.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:35.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:35.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:35.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:35.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:35.426 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:35.634 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:35.635 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:35.635 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:35.635 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:35.917 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:35.917 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-18T01:18:35.917 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-18T01:18:35.917 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-18T01:18:35.917 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:35.917 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-18T01:18:36.017 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:36.017 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:36.018 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:36.018 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:36.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:36.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:36.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:36.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:36.232 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:36.232 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:36.233 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:36.233 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:36.516 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:36.516 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:36.517 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:36.517 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:36.517 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:36.517 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:36.517 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:36.517 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:36.517 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:36.796 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:36.796 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:36.796 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-18T01:18:36.796 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:36.796 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-18T01:18:36.996 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:36.997 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:36.997 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:36.998 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:36.998 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:36.998 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:36.998 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:36.998 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:37.203 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:37.204 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:37.204 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:37.204 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:37.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:37.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:37.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:37.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:37.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:37.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:37.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:37.486 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:37.487 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:37.761 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:37.762 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:37.762 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-18T01:18:37.762 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:37.762 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-18T01:18:38.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:38.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:38.163 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:38.164 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:38.164 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:38.164 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:38.164 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:38.164 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:38.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:38.383 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:38.383 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:38.383 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:38.669 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:38.669 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:38.669 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:38.669 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:38.669 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:38.670 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:38.670 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:38.670 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:38.670 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:38.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:38.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:38.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-18T01:18:38.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:38.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-18T01:18:39.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:39.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:39.751 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:39.752 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:39.752 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:39.752 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:39.752 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:39.752 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:39.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:39.965 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:39.966 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:39.966 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:40.252 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:40.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:40.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:40.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:40.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:40.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:40.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:40.253 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:40.253 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:40.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:40.542 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:40.542 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-18T01:18:40.542 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:40.542 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-18T01:18:42.142 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:42.142 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:42.142 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:42.142 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:42.142 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:42.142 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:42.143 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:42.143 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:42.357 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:42.358 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:42.358 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:42.358 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:42.643 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:42.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:42.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:42.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:42.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:42.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:42.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:42.644 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:42.644 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:42.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:42.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:42.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-18T01:18:42.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:42.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-18T01:18:46.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:46.139 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:46.140 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:46.140 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:46.140 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:46.140 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:46.140 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:46.140 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:46.354 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:46.354 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:46.354 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:46.355 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:46.641 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:46.641 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:46.641 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:46.641 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:46.642 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:46.642 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:46.642 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:46.642 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:46.642 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:46.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:46.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:46.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-18T01:18:46.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:46.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-18T01:18:53.328 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:18:53.329 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:18:53.329 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:18:53.329 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:18:53.329 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:18:53.329 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:18:53.330 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:18:53.330 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:18:53.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:18:53.541 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:18:53.541 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:18:53.542 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:18:53.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:18:53.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:18:53.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:18:53.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:18:53.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:18:53.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:18:53.822 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:18:53.822 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:18:53.822 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:18:54.109 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:18:54.109 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:18:54.109 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-18T01:18:54.109 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:18:54.109 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-18T01:19:01.409 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:19:01.410 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:19:01.411 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:19:01.411 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:19:01.411 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:19:01.411 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:19:01.411 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:19:01.411 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:19:01.620 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:19:01.621 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:19:01.621 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:19:01.621 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:19:01.906 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:19:01.906 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:19:01.907 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:19:01.907 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:19:01.907 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:19:01.907 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:19:01.907 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:19:01.907 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:19:01.907 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:19:02.193 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:19:02.193 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:19:02.193 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-18T01:19:02.193 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-18T01:19:02.472 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:19:02.472 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_fingerprint": "e88847b4-c5f7-4665-b9c6-c04a0711b2bb", 2026-02-18T01:19:02.472 INFO:tasks.workunit.client.0.trial080.stdout: "version": "20.2.0-670-gadc19233", 2026-02-18T01:19:02.472 INFO:tasks.workunit.client.0.trial080.stdout: "commit": "adc1923395f2bcd6ae89b5d331d278364d1848ed", 2026-02-18T01:19:02.472 INFO:tasks.workunit.client.0.trial080.stdout: "timestamp": "2026-02-18T01:19:02.467742+0000", 2026-02-18T01:19:02.472 INFO:tasks.workunit.client.0.trial080.stdout: "tag": "", 2026-02-18T01:19:02.473 INFO:tasks.workunit.client.0.trial080.stdout: "health": { 2026-02-18T01:19:02.473 INFO:tasks.workunit.client.0.trial080.stdout: "status": "HEALTH_WARN", 2026-02-18T01:19:02.473 INFO:tasks.workunit.client.0.trial080.stdout: "checks": { 2026-02-18T01:19:02.473 INFO:tasks.workunit.client.0.trial080.stdout: "OSDMAP_FLAGS": { 2026-02-18T01:19:02.473 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:19:02.473 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:19:02.473 INFO:tasks.workunit.client.0.trial080.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-18T01:19:02.473 INFO:tasks.workunit.client.0.trial080.stdout: "count": 17 2026-02-18T01:19:02.473 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.473 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [], 2026-02-18T01:19:02.473 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:19:02.473 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.474 INFO:tasks.workunit.client.0.trial080.stdout: "OSD_DOWN": { 2026-02-18T01:19:02.474 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:19:02.474 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:19:02.474 INFO:tasks.workunit.client.0.trial080.stdout: "message": "1 osds down", 2026-02-18T01:19:02.474 INFO:tasks.workunit.client.0.trial080.stdout: "count": 1 2026-02-18T01:19:02.474 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.474 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:19:02.474 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.474 INFO:tasks.workunit.client.0.trial080.stdout: "message": "osd.1 (root=default,host=trial080) is down" 2026-02-18T01:19:02.474 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.474 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.475 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:19:02.475 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.475 INFO:tasks.workunit.client.0.trial080.stdout: "PG_DEGRADED": { 2026-02-18T01:19:02.475 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:19:02.475 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:19:02.475 INFO:tasks.workunit.client.0.trial080.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-18T01:19:02.475 INFO:tasks.workunit.client.0.trial080.stdout: "count": 1 2026-02-18T01:19:02.475 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.475 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:19:02.475 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.475 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:19:02.475 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.476 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.476 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:19:02.476 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.476 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.476 INFO:tasks.workunit.client.0.trial080.stdout: "mutes": [] 2026-02-18T01:19:02.476 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.476 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_first_committed": 1, 2026-02-18T01:19:02.476 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_last_committed": 1, 2026-02-18T01:19:02.476 INFO:tasks.workunit.client.0.trial080.stdout: "monmap": { 2026-02-18T01:19:02.476 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:19:02.476 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:19:02.476 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:17:19.937166Z", 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:17:19.937166Z", 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release": 20, 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release_name": "tentacle", 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "election_strategy": 1, 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "disallowed_leaders": "", 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": false, 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "tiebreaker_mon": "", 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "removed_ranks": "", 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "features": { 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "persistent": [ 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "kraken", 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "luminous", 2026-02-18T01:19:02.477 INFO:tasks.workunit.client.0.trial080.stdout: "mimic", 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap-prune", 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: "nautilus", 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: "octopus", 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: "pacific", 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: "elector-pinging", 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: "quincy", 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: "reef", 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: "squid", 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: "tentacle", 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: "nvmeof_beacon_diff" 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: "optional": [] 2026-02-18T01:19:02.478 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: "mons": [ 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: "rank": 0, 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: "name": "a", 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115", 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 0 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.479 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115/0", 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: "priority": 0, 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 0, 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: "crush_location": "{}" 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: "quorum": [ 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: 0 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap": { 2026-02-18T01:19:02.480 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 41, 2026-02-18T01:19:02.481 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:19:02.481 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:17:19.997728+0000", 2026-02-18T01:19:02.481 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:18:03.247081+0000", 2026-02-18T01:19:02.481 INFO:tasks.workunit.client.0.trial080.stdout: "last_up_change": "2026-02-18T01:18:02.336442+0000", 2026-02-18T01:19:02.481 INFO:tasks.workunit.client.0.trial080.stdout: "last_in_change": "2026-02-18T01:18:03.144841+0000", 2026-02-18T01:19:02.481 INFO:tasks.workunit.client.0.trial080.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-18T01:19:02.481 INFO:tasks.workunit.client.0.trial080.stdout: "flags_num": 5800384, 2026-02-18T01:19:02.481 INFO:tasks.workunit.client.0.trial080.stdout: "flags_set": [ 2026-02-18T01:19:02.481 INFO:tasks.workunit.client.0.trial080.stdout: "nodown", 2026-02-18T01:19:02.481 INFO:tasks.workunit.client.0.trial080.stdout: "noin", 2026-02-18T01:19:02.481 INFO:tasks.workunit.client.0.trial080.stdout: "noout", 2026-02-18T01:19:02.481 INFO:tasks.workunit.client.0.trial080.stdout: "pglog_hardlimit", 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snapdirs", 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: "recovery_deletes", 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: "sortbitwise" 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: "crush_version": 9, 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: "full_ratio": 0.99000000953674316, 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_snapshot": "", 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: "pool_max": 1, 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: "max_osd": 3, 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: "require_min_compat_client": "luminous", 2026-02-18T01:19:02.482 INFO:tasks.workunit.client.0.trial080.stdout: "min_compat_client": "jewel", 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: "require_osd_release": "tentacle", 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: "allow_crimson": false, 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: "pools": [ 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: "pool_name": "test", 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: "create_time": "2026-02-18T01:17:33.153347+0000", 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: "flags": 1, 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: "flags_names": "hashpspool", 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: "type": 1, 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: "size": 3, 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: "min_size": 2, 2026-02-18T01:19:02.483 INFO:tasks.workunit.client.0.trial080.stdout: "crush_rule": 0, 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_count": 0, 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_target": 0, 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_barrier": 0, 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "is_stretch_pool": false, 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "object_hash": 2, 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "pg_autoscale_mode": "off", 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num": 1, 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num": 1, 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num_target": 1, 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_target": 1, 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_pending": 1, 2026-02-18T01:19:02.484 INFO:tasks.workunit.client.0.trial080.stdout: "last_pg_merge_meta": { 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "source_pgid": "0.0", 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "ready_epoch": 0, 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_started": 0, 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": 0, 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "source_version": "0'0", 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "target_version": "0'0" 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "last_change": "26", 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend": "0", 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_preluminous": "0", 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "auid": 0, 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "snap_mode": "selfmanaged", 2026-02-18T01:19:02.485 INFO:tasks.workunit.client.0.trial080.stdout: "snap_seq": 0, 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "snap_epoch": 0, 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "pool_snaps": [], 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps": "[]", 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_bytes": 0, 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_objects": 0, 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "tiers": [], 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "tier_of": -1, 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "read_tier": -1, 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "write_tier": -1, 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "cache_mode": "none", 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_bytes": 0, 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_objects": 0, 2026-02-18T01:19:02.486 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_flush_age": 0, 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_evict_age": 0, 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profile": "", 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_params": { 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: "type": "none" 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_period": 0, 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_count": 0, 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: "use_gmt_hitset": true, 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: "min_read_recency_for_promote": 0, 2026-02-18T01:19:02.487 INFO:tasks.workunit.client.0.trial080.stdout: "min_write_recency_for_promote": 0, 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_grade_decay_rate": 0, 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_search_last_n": 0, 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "grade_table": [], 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "stripe_width": 0, 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "expected_num_objects": 0, 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "fast_read": false, 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "nonprimary_shards": "{}", 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "options": {}, 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "application_metadata": {}, 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "read_balance": { 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "score_type": "Fair distribution", 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "score_acting": 2.9900000095367432, 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "score_stable": 2.9900000095367432, 2026-02-18T01:19:02.488 INFO:tasks.workunit.client.0.trial080.stdout: "optimal_score": 0.67000001668930054, 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: "raw_score_acting": 2, 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: "raw_score_stable": 2, 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity_weighted": 1, 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: "average_primary_affinity": 1, 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: "average_primary_affinity_weighted": 1 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: "osds": [ 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "c2fc521e-bbd5-4196-a06b-8c1a91280dfc", 2026-02-18T01:19:02.489 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 5, 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 29, 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 36, 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 40, 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 30, 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.490 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.491 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6800", 2026-02-18T01:19:02.491 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:19:02.491 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.491 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.491 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:19:02.491 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6801", 2026-02-18T01:19:02.491 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:19:02.491 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.491 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.491 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.491 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:19:02.491 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6802", 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6803", 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.492 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6806", 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6807", 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.493 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6804", 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6805", 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 6869586 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.494 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6801/6869586", 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6803/6869586", 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6807/6869586", 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6805/6869586", 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:19:02.495 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "24dc2c71-9b2f-48eb-8710-5374b5af4325", 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "up": 0, 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 0, 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 0, 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 9, 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 20, 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 31, 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.496 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.497 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.498 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:19:02.499 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3076030162 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.500 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/3076030162", 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/3076030162", 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3076030162", 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3076030162", 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: "exists" 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "007ddce5-6ad7-4f29-9f6a-d9b4b893c37f", 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:19:02.501 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 13, 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 29, 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 38, 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 0, 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 32, 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:19:02.502 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:19:02.503 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.504 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.505 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 1962413313 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/1962413313", 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/1962413313", 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1962413313", 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1962413313", 2026-02-18T01:19:02.506 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: "osd_xinfo": [ 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:17:57.902132+0000", 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:19:02.507 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:17:23.685005+0000", 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:17:58.191200+0000", 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:17:27.294418+0000", 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.508 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:17:58.479472+0000", 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:17:31.298900+0000", 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap": [], 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_items": [], 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_primaries": [], 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "pg_temp": [], 2026-02-18T01:19:02.509 INFO:tasks.workunit.client.0.trial080.stdout: "primary_temp": [], 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "blocklist": {}, 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "range_blocklist": {}, 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profiles": { 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "default": { 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "k": "2", 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "m": "2", 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "plugin": "isa", 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "technique": "reed_sol_van" 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps_queue": [], 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "new_removed_snaps": [], 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "new_purged_snaps": [], 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "crush_node_flags": {}, 2026-02-18T01:19:02.510 INFO:tasks.workunit.client.0.trial080.stdout: "device_class_flags": {}, 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": { 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_enabled": false, 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_bucket_count": 0, 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: "degraded_stretch_mode": 0, 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: "recovering_stretch_mode": 0, 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_bucket": 0 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: "osd_metadata": [ 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:19:02.511 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6802/6869586,v1:127.0.0.1:6803/6869586]", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:19:02.512 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:17:21.004332Z", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:19:02.513 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6800/6869586,v1:127.0.0.1:6801/6869586]", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/6869586,v1:127.0.0.1:6807/6869586]", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/6869586,v1:127.0.0.1:6805/6869586]", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:19:02.514 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/0", 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:19:02.515 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/3076030162,v1:127.0.0.1:6813/3076030162]", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-18T01:19:02.516 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:17:24.744972Z", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:19:02.517 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/3076030162,v1:127.0.0.1:6811/3076030162]", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3076030162,v1:127.0.0.1:6817/3076030162]", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3076030162,v1:127.0.0.1:6815/3076030162]", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:19:02.518 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/1", 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/1962413313,v1:127.0.0.1:6813/1962413313]", 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:19:02.519 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:19:02.520 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:17:28.794248Z", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/1962413313,v1:127.0.0.1:6811/1962413313]", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1962413313,v1:127.0.0.1:6817/1962413313]", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1962413313,v1:127.0.0.1:6815/1962413313]", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:19:02.521 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/2", 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_clean_epochs": { 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "min_last_epoch_clean": 24, 2026-02-18T01:19:02.522 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": { 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: "per_pool": [ 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": 1, 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: "floor": 24 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: "osd_epochs": [ 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 36 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 40 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.523 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_first_committed": 1, 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_last_committed": 41, 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "crushmap": { 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "devices": [ 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.0", 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.1", 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.2", 2026-02-18T01:19:02.524 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: "types": [ 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 0, 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd" 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: "name": "host" 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 2, 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: "name": "chassis" 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 3, 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: "name": "rack" 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.525 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 4, 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: "name": "row" 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 5, 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pdu" 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 6, 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pod" 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 7, 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: "name": "room" 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 8, 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: "name": "datacenter" 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.526 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 9, 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "name": "zone" 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 10, 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "name": "region" 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "name": "root" 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "buckets": [ 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "id": -1, 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default", 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:19:02.527 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "id": -2, 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default~ssd", 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.528 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080", 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:19:02.529 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080~ssd", 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.530 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "rules": [ 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "rule_id": 0, 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "rule_name": "replicated_rule", 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "type": 1, 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "steps": [ 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "op": "take", 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "item": -1, 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "item_name": "default" 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "op": "choose_firstn", 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "num": 0, 2026-02-18T01:19:02.531 INFO:tasks.workunit.client.0.trial080.stdout: "type": "osd" 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "op": "emit" 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "tunables": { 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_tries": 0, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_fallback_tries": 0, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "choose_total_tries": 50, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_descend_once": 1, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_vary_r": 1, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_stable": 1, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "msr_descents": 100, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "msr_collision_tries": 100, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "straw_calc_version": 1, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "allowed_bucket_algs": 54, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "profile": "jewel", 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "optimal_tunables": 1, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "legacy_tunables": 0, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "minimum_required_version": "jewel", 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables": 1, 2026-02-18T01:19:02.532 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables2": 1, 2026-02-18T01:19:02.533 INFO:tasks.workunit.client.0.trial080.stdout: "has_v2_rules": 0, 2026-02-18T01:19:02.533 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables3": 1, 2026-02-18T01:19:02.533 INFO:tasks.workunit.client.0.trial080.stdout: "has_v3_rules": 0, 2026-02-18T01:19:02.533 INFO:tasks.workunit.client.0.trial080.stdout: "has_v4_buckets": 1, 2026-02-18T01:19:02.533 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables5": 1, 2026-02-18T01:19:02.533 INFO:tasks.workunit.client.0.trial080.stdout: "has_v5_rules": 0, 2026-02-18T01:19:02.533 INFO:tasks.workunit.client.0.trial080.stdout: "has_msr_rules": 0 2026-02-18T01:19:02.533 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.533 INFO:tasks.workunit.client.0.trial080.stderr:report 1240980553 2026-02-18T01:19:02.533 INFO:tasks.workunit.client.0.trial080.stdout: "choose_args": {} 2026-02-18T01:19:02.533 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.533 INFO:tasks.workunit.client.0.trial080.stdout: "fsmap": { 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "btime": "2026-02-18T01:17:19:997570+0000", 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "default_fscid": -1, 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "compat": { 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "compat": {}, 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "ro_compat": {}, 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "incompat": { 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "feature_1": "base v0.20", 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "feature_2": "client writeable ranges", 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "feature_3": "default file layouts on dirs", 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "feature_4": "dir inode in separate object", 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "feature_5": "mds uses versioned encoding", 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "feature_8": "no anchor table", 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "feature_9": "file layout v2", 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "feature_10": "snaprealm v2", 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "feature_11": "minor log segments", 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "feature_12": "quiesce subvolumes" 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "feature_flags": { 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "enable_multiple": true, 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: "ever_enabled_multiple": true 2026-02-18T01:19:02.534 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "standbys": [], 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "filesystems": [] 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_first_committed": 1, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_last_committed": 1, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "auth": { 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 5, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_secrets": 3 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 1, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_active": 1, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_unknown": 0, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_osd": 3, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "pool_sum": { 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 51688, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 100, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 0, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 300, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 100, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:19:02.535 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 100, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 101, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 101, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:19:02.536 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 17, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 17, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "up": 2, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 2, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 0 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum": { 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:19:02.537 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 3, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 83888, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2104, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 22, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 81705, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314488912, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322036645888, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2154496, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 435923, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 23448, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 83666024 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 0, 2026-02-18T01:19:02.538 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum_by_class": { 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "ssd": { 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 3, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 83888, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2104, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 22, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 81705, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314488912, 2026-02-18T01:19:02.539 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322036645888, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2154496, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 435923, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 23448, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 83666024 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 0, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:19:02.540 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "pool_stats": [ 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": 1, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 1, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 51688, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 100, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 300, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 100, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 100, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 101, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 101, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:19:02.541 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 1220608, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 154528, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:19:02.542 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 17, 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 17, 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "up": 2, 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 2, 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 3 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "osd_stats": [ 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 154618822672 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 38654705677 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 163208757264 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_state": [ 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "state": "active+undersized+degraded", 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "num": 1 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "pool_pg_unavailable_map": [ 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.543 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": "1", 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "pgs": [] 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_osd": [ 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 1, 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 1, 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 1, 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 0, 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": [ 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": {} 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.544 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "servicemap": { 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 3, 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:18:28.482554+0000", 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "services": { 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "osd": { 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "daemons": { 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "summary": "", 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "0": { 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "start_epoch": 0, 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "start_stamp": "0.000000", 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "gid": 0, 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "metadata": {}, 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "task_status": {} 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "2": { 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "start_epoch": 0, 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "start_stamp": "0.000000", 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "gid": 0, 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "metadata": {}, 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "task_status": {} 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_first_committed": 1, 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_last_committed": 51, 2026-02-18T01:19:02.545 INFO:tasks.workunit.client.0.trial080.stdout: "logm_first_committed": 1, 2026-02-18T01:19:02.546 INFO:tasks.workunit.client.0.trial080.stdout: "logm_last_committed": 282, 2026-02-18T01:19:02.546 INFO:tasks.workunit.client.0.trial080.stdout: "paxos": { 2026-02-18T01:19:02.546 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:19:02.546 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 383, 2026-02-18T01:19:02.546 INFO:tasks.workunit.client.0.trial080.stdout: "last_pn": 0, 2026-02-18T01:19:02.546 INFO:tasks.workunit.client.0.trial080.stdout: "accepted_pn": 0 2026-02-18T01:19:02.546 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:19:02.546 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:19:02.546 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-18T01:19:02.546 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: echo 'delay recovery' 2026-02-18T01:19:02.546 INFO:tasks.workunit.client.0.trial080.stdout:delay recovery 2026-02-18T01:19:02.546 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:539: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:19:02.682 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:19:02.682 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-18T01:18:03.250343+0000 41'101 41:135 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 periodic scrub scheduled @ 2026-02-19T12:44:07.695895+0000 0 0 2026-02-18T01:19:02.682 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:19:02.682 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:19:02.683 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:19:02.693 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-18T01:19:02.693 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.0 2026-02-18T01:19:02.693 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T01:19:02.693 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T01:19:02.694 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:19:02.694 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:02.694 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:02.695 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.0.asok 2026-02-18T01:19:02.695 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-18T01:19:02.695 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.0.asok set_recovery_delay 100000 2026-02-18T01:19:02.759 INFO:tasks.workunit.client.0.trial080.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-18T01:19:02.764 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-18T01:19:02.766 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.2 2026-02-18T01:19:02.766 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-18T01:19:02.766 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-18T01:19:02.766 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:19:02.766 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:02.766 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:02.766 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.2.asok 2026-02-18T01:19:02.767 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-18T01:19:02.767 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.2.asok set_recovery_delay 100000 2026-02-18T01:19:02.821 INFO:tasks.workunit.client.0.trial080.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-18T01:19:02.826 INFO:tasks.workunit.client.0.trial080.stdout:revive divergent 1 2026-02-18T01:19:02.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:546: TEST_divergent_2: echo 'revive divergent 1' 2026-02-18T01:19:02.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:547: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:19:03.044 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:19:03.044 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-18T01:18:03.250343+0000 41'101 41:135 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 periodic scrub scheduled @ 2026-02-19T12:44:07.695895+0000 0 0 2026-02-18T01:19:03.044 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:19:03.045 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:19:03.045 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:19:03.053 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:548: TEST_divergent_2: ceph osd set noup 2026-02-18T01:19:03.384 INFO:tasks.workunit.client.0.trial080.stderr:noup is set 2026-02-18T01:19:03.400 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:549: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-18T01:19:03.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:19:03.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:19:03.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:19:03.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:19:03.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-18T01:19:03.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:19:03.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:19:03.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:19:03.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:19:03.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-18T01:19:03.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-18T01:19:03.402 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:19:03.402 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:19:03.402 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:19:03.402 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:19:03.402 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:19:03.402 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:19:03.402 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:19:03.402 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:03.402 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:03.402 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:19:03.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:19:03.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:19:03.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:19:03.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:19:03.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:19:03.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:19:03.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:19:03.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:19:03.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:19:03.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:19:03.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-18T01:19:03.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:19:03.405 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:19:03.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:19:03.406 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-18T01:19:03.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:19:03.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:19:03.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:19:03.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:19:03.424 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:03.417+0000 7f8ecda33a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:03.426 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:03.421+0000 7f8ecda33a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:03.427 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:03.421+0000 7f8ecda33a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:03.617 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-18T01:19:03.618 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:550: TEST_divergent_2: sleep 5 2026-02-18T01:19:03.823 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:03.817+0000 7f8ecda33a40 -1 Falling back to public interface 2026-02-18T01:19:04.476 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:04.469+0000 7f8ecda33a40 -1 osd.1 29 log_to_monitors true 2026-02-18T01:19:08.618 INFO:tasks.workunit.client.0.trial080.stdout:delay recovery divergent 2026-02-18T01:19:08.619 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: echo 'delay recovery divergent' 2026-02-18T01:19:08.619 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:553: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:19:08.823 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:19:08.823 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-18T01:18:03.250343+0000 41'101 44:141 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 periodic scrub scheduled @ 2026-02-19T12:44:07.695895+0000 0 0 2026-02-18T01:19:08.823 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:19:08.823 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:19:08.824 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:19:08.834 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: get_asok_path osd.1 2026-02-18T01:19:08.834 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T01:19:08.834 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T01:19:08.835 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:19:08.835 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:08.835 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:08.835 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.1.asok 2026-02-18T01:19:08.835 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: CEPH_ARGS= 2026-02-18T01:19:08.836 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.1.asok set_recovery_delay 100000 2026-02-18T01:19:08.899 INFO:tasks.workunit.client.0.trial080.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-18T01:19:08.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:556: TEST_divergent_2: ceph osd unset noup 2026-02-18T01:19:09.223 INFO:tasks.workunit.client.0.trial080.stderr:noup is unset 2026-02-18T01:19:09.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:558: TEST_divergent_2: wait_for_osd up 0 2026-02-18T01:19:09.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:19:09.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:19:09.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:19:09.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:19:09.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:09.235 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:19:09.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:19:09.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:09.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:19:09.452 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 36 up_thru 40 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6800/6869586,v1:127.0.0.1:6801/6869586] [v2:127.0.0.1:6802/6869586,v1:127.0.0.1:6803/6869586] exists,up c2fc521e-bbd5-4196-a06b-8c1a91280dfc 2026-02-18T01:19:09.453 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:19:09.453 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:19:09.453 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:19:09.453 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:559: TEST_divergent_2: wait_for_osd up 1 2026-02-18T01:19:09.453 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:19:09.453 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:19:09.453 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:19:09.453 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:19:09.453 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:09.453 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:19:09.454 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:19:09.454 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:09.454 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:19:09.668 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/2987097470,v1:127.0.0.1:6819/2987097470] [v2:127.0.0.1:6820/2987097470,v1:127.0.0.1:6821/2987097470] exists,up 24dc2c71-9b2f-48eb-8710-5374b5af4325 2026-02-18T01:19:09.668 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:19:09.668 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:19:09.668 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:19:09.668 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:560: TEST_divergent_2: wait_for_osd up 2 2026-02-18T01:19:09.668 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:19:09.668 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:19:09.668 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:19:09.668 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:19:09.668 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:09.669 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:19:09.669 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:19:09.669 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:09.669 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:19:09.881 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 32 last_clean_interval [13,29) [v2:127.0.0.1:6810/1962413313,v1:127.0.0.1:6811/1962413313] [v2:127.0.0.1:6812/1962413313,v1:127.0.0.1:6813/1962413313] exists,up 007ddce5-6ad7-4f29-9f6a-d9b4b893c37f 2026-02-18T01:19:09.881 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:19:09.881 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:19:09.881 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:19:09.881 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:562: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:19:10.079 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:19:10.079 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-18T01:18:03.250343+0000 41'101 44:141 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 periodic scrub scheduled @ 2026-02-19T12:44:07.695895+0000 0 0 2026-02-18T01:19:10.079 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:19:10.079 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:19:10.079 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:19:10.088 INFO:tasks.workunit.client.0.trial080.stdout:wait for peering 2026-02-18T01:19:10.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:563: TEST_divergent_2: echo 'wait for peering' 2026-02-18T01:19:10.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:564: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:19:10.305 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:19:10.306 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-18T01:18:03.250343+0000 41'101 44:141 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 periodic scrub scheduled @ 2026-02-19T12:44:07.695895+0000 0 0 2026-02-18T01:19:10.306 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:19:10.306 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:19:10.306 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:19:10.316 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:565: TEST_divergent_2: rados -p test put foo /tmp/tmp.j4BqkTY94A 2026-02-18T01:19:10.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:566: TEST_divergent_2: rm -f /tmp/tmp.j4BqkTY94A 2026-02-18T01:19:10.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:570: TEST_divergent_2: echo 'killing divergent 1' 2026-02-18T01:19:10.339 INFO:tasks.workunit.client.0.trial080.stdout:killing divergent 1 2026-02-18T01:19:10.339 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:571: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:19:10.546 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:19:10.546 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 peering 2026-02-18T01:19:09.222324+0000 29'106 46:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:19:10.546 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:19:10.546 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:19:10.547 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:19:10.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:572: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd.1 2026-02-18T01:19:10.555 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:19:10.555 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:19:10.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:19:10.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:19:10.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:19:10.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:19:10.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:575: TEST_divergent_2: expfile=td/divergent-priors/exp.16037.out 2026-02-18T01:19:10.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:576: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16037.out 2026-02-18T01:19:10.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-18T01:19:10.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T01:19:10.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T01:19:10.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T01:19:10.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-18T01:19:10.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16037.out 2026-02-18T01:19:10.858 INFO:tasks.workunit.client.0.trial080.stderr:Exporting 1.0 info 1.0( v 47'102 lc 0'0 (29'90,47'102] local-lis/les=46/47 n=101 ec=20/20 lis/c=46/20 les/c/f=47/21/0 sis=46) 2026-02-18T01:19:10.859 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-18T01:19:10.859 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-18T01:19:10.859 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-18T01:19:10.859 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:091f9f1d:::existing_94:head# 2026-02-18T01:19:10.859 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:0a865a93:::existing_54:head# 2026-02-18T01:19:10.860 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:0fed513c:::existing_41:head# 2026-02-18T01:19:10.860 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:13b9e0b8:::existing_92:head# 2026-02-18T01:19:10.860 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:169157fa:::existing_81:head# 2026-02-18T01:19:10.860 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:17731382:::existing_58:head# 2026-02-18T01:19:10.860 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:18a45a39:::existing_43:head# 2026-02-18T01:19:10.860 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:1c160f01:::existing_66:head# 2026-02-18T01:19:10.860 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:1dd6c249:::existing_97:head# 2026-02-18T01:19:10.861 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:227e0c77:::existing_7:head# 2026-02-18T01:19:10.861 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:23e1b063:::existing_59:head# 2026-02-18T01:19:10.861 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:28566edb:::existing_78:head# 2026-02-18T01:19:10.861 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:2a101182:::existing_20:head# 2026-02-18T01:19:10.861 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:2d1519da:::existing_96:head# 2026-02-18T01:19:10.862 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:3078b87a:::existing_86:head# 2026-02-18T01:19:10.862 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:30bde01b:::existing_15:head# 2026-02-18T01:19:10.862 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:317a7e19:::existing_56:head# 2026-02-18T01:19:10.862 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:38b9c7fa:::existing_33:head# 2026-02-18T01:19:10.862 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:3e16d84b:::existing_48:head# 2026-02-18T01:19:10.862 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:45fe8203:::existing_75:head# 2026-02-18T01:19:10.863 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:4e82c9ba:::existing_50:head# 2026-02-18T01:19:10.863 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:5298dcdb:::existing_57:head# 2026-02-18T01:19:10.863 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:52ebaa44:::existing_32:head# 2026-02-18T01:19:10.863 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:53588912:::existing_9:head# 2026-02-18T01:19:10.863 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:5b7e2de6:::existing_84:head# 2026-02-18T01:19:10.863 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:5da0255c:::existing_13:head# 2026-02-18T01:19:10.864 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:5da2dab8:::existing_53:head# 2026-02-18T01:19:10.864 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:5ee3514b:::existing_30:head# 2026-02-18T01:19:10.864 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:602f83fe:::foo:head# 2026-02-18T01:19:10.864 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:60426cc7:::existing_62:head# 2026-02-18T01:19:10.864 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:628918ca:::existing_79:head# 2026-02-18T01:19:10.864 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:63f8ab2d:::existing_77:head# 2026-02-18T01:19:10.865 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:67e1780f:::existing_27:head# 2026-02-18T01:19:10.865 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:68143ca1:::existing_71:head# 2026-02-18T01:19:10.865 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:6bac9509:::existing_29:head# 2026-02-18T01:19:10.865 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:6bbec798:::existing_45:head# 2026-02-18T01:19:10.865 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:6cb23a40:::existing_65:head# 2026-02-18T01:19:10.865 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:7055ec5e:::existing_83:head# 2026-02-18T01:19:10.866 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:70a54e2b:::existing_87:head# 2026-02-18T01:19:10.866 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:750ace21:::existing_19:head# 2026-02-18T01:19:10.866 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:78623b1d:::existing_6:head# 2026-02-18T01:19:10.866 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:79881152:::existing_63:head# 2026-02-18T01:19:10.866 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:7a80c0d5:::existing_99:head# 2026-02-18T01:19:10.866 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:81490677:::existing_76:head# 2026-02-18T01:19:10.867 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:85ec8e5d:::existing_85:head# 2026-02-18T01:19:10.867 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:8e2abbf0:::existing_49:head# 2026-02-18T01:19:10.867 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:8ee0fe0f:::existing_52:head# 2026-02-18T01:19:10.867 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:923c5d4d:::existing_5:head# 2026-02-18T01:19:10.867 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:92731e71:::existing_89:head# 2026-02-18T01:19:10.868 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:928205cf:::existing_82:head# 2026-02-18T01:19:10.868 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:93be2267:::existing_24:head# 2026-02-18T01:19:10.868 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:99ceda2c:::existing_44:head# 2026-02-18T01:19:10.868 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:9dd917ee:::existing_26:head# 2026-02-18T01:19:10.868 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:a28805a6:::existing_72:head# 2026-02-18T01:19:10.868 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:a294a8f6:::existing_16:head# 2026-02-18T01:19:10.869 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:a2f5473a:::existing_42:head# 2026-02-18T01:19:10.869 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:a504a533:::existing_90:head# 2026-02-18T01:19:10.869 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:a691337e:::existing_61:head# 2026-02-18T01:19:10.869 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:a6e8d7ac:::existing_28:head# 2026-02-18T01:19:10.869 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:a9fde86e:::existing_18:head# 2026-02-18T01:19:10.869 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:aa309faa:::existing_68:head# 2026-02-18T01:19:10.870 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:ae40b0ed:::existing_31:head# 2026-02-18T01:19:10.870 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:b279b1fe:::existing_10:head# 2026-02-18T01:19:10.870 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:b343e277:::existing_88:head# 2026-02-18T01:19:10.870 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:b7130e90:::existing_80:head# 2026-02-18T01:19:10.870 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:bc6f7309:::existing_70:head# 2026-02-18T01:19:10.870 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:be8489b7:::existing_38:head# 2026-02-18T01:19:10.871 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:beb4e5e3:::existing_47:head# 2026-02-18T01:19:10.871 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:bebec877:::existing_74:head# 2026-02-18T01:19:10.871 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:c04347d8:::existing_60:head# 2026-02-18T01:19:10.871 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:c156033e:::existing_100:head# 2026-02-18T01:19:10.871 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:c19f5a8e:::existing_8:head# 2026-02-18T01:19:10.871 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:c3e6ebe4:::existing_17:head# 2026-02-18T01:19:10.872 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:c6c5a7c2:::existing_39:head# 2026-02-18T01:19:10.872 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:cc1d0abf:::existing_95:head# 2026-02-18T01:19:10.872 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:ccb3865b:::existing_73:head# 2026-02-18T01:19:10.872 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:cd84e19e:::existing_40:head# 2026-02-18T01:19:10.872 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:d2cd64ce:::existing_37:head# 2026-02-18T01:19:10.872 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:d41a25c9:::existing_22:head# 2026-02-18T01:19:10.873 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:d7f088da:::existing_91:head# 2026-02-18T01:19:10.873 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:d9cbd1d6:::existing_64:head# 2026-02-18T01:19:10.873 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:dcc4ff82:::existing_98:head# 2026-02-18T01:19:10.873 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:dd677bd3:::existing_35:head# 2026-02-18T01:19:10.873 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:dd6d90e7:::existing_46:head# 2026-02-18T01:19:10.873 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:e0e22077:::existing_21:head# 2026-02-18T01:19:10.874 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:e255b710:::existing_55:head# 2026-02-18T01:19:10.874 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:eff1d5db:::existing_14:head# 2026-02-18T01:19:10.874 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:f1b156bf:::existing_23:head# 2026-02-18T01:19:10.874 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:f5ce4199:::existing_34:head# 2026-02-18T01:19:10.874 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:f6809456:::existing_11:head# 2026-02-18T01:19:10.875 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:f699a2a9:::existing_67:head# 2026-02-18T01:19:10.875 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:f9baac43:::existing_25:head# 2026-02-18T01:19:10.875 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:fb76688e:::existing_51:head# 2026-02-18T01:19:10.875 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:fbb92eec:::existing_69:head# 2026-02-18T01:19:10.875 INFO:tasks.workunit.client.0.trial080.stderr:Export successful 2026-02-18T01:19:10.875 INFO:tasks.workunit.client.0.trial080.stdout: marking collection for removal 2026-02-18T01:19:10.875 INFO:tasks.workunit.client.0.trial080.stdout:setting '_remove' omap key 2026-02-18T01:19:10.875 INFO:tasks.workunit.client.0.trial080.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-18T01:19:10.876 INFO:tasks.workunit.client.0.trial080.stderr:Remove successful 2026-02-18T01:19:10.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:577: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.16037.out 2026-02-18T01:19:10.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-18T01:19:10.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T01:19:10.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T01:19:10.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T01:19:10.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-18T01:19:10.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.16037.out 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:get_pg_num_history pg_num_history pg_num_history(e47 pg_nums {1={20=1}} deleted_pools ) 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:Importing pgid 1.0 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:091f9f1d:::existing_94:head# 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:0a865a93:::existing_54:head# 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:0fed513c:::existing_41:head# 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:13b9e0b8:::existing_92:head# 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:169157fa:::existing_81:head# 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:17731382:::existing_58:head# 2026-02-18T01:19:11.208 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:18a45a39:::existing_43:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:1c160f01:::existing_66:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:1dd6c249:::existing_97:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:227e0c77:::existing_7:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:23e1b063:::existing_59:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:28566edb:::existing_78:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:2a101182:::existing_20:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:2d1519da:::existing_96:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:3078b87a:::existing_86:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:30bde01b:::existing_15:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:317a7e19:::existing_56:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:38b9c7fa:::existing_33:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:3e16d84b:::existing_48:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:45fe8203:::existing_75:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:4e82c9ba:::existing_50:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:5298dcdb:::existing_57:head# 2026-02-18T01:19:11.209 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:52ebaa44:::existing_32:head# 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:53588912:::existing_9:head# 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:5b7e2de6:::existing_84:head# 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:5da0255c:::existing_13:head# 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:5da2dab8:::existing_53:head# 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:5ee3514b:::existing_30:head# 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:602f83fe:::foo:head# 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:60426cc7:::existing_62:head# 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:628918ca:::existing_79:head# 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:63f8ab2d:::existing_77:head# 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:67e1780f:::existing_27:head# 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:68143ca1:::existing_71:head# 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.211 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:6bac9509:::existing_29:head# 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:6bbec798:::existing_45:head# 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:6cb23a40:::existing_65:head# 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:7055ec5e:::existing_83:head# 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:70a54e2b:::existing_87:head# 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:750ace21:::existing_19:head# 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:78623b1d:::existing_6:head# 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:79881152:::existing_63:head# 2026-02-18T01:19:11.212 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:7a80c0d5:::existing_99:head# 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:81490677:::existing_76:head# 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:85ec8e5d:::existing_85:head# 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:8e2abbf0:::existing_49:head# 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:8ee0fe0f:::existing_52:head# 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:923c5d4d:::existing_5:head# 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:92731e71:::existing_89:head# 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:928205cf:::existing_82:head# 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:93be2267:::existing_24:head# 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:99ceda2c:::existing_44:head# 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:9dd917ee:::existing_26:head# 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:a28805a6:::existing_72:head# 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.213 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:a294a8f6:::existing_16:head# 2026-02-18T01:19:11.214 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.214 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:a2f5473a:::existing_42:head# 2026-02-18T01:19:11.214 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.214 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:a504a533:::existing_90:head# 2026-02-18T01:19:11.214 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.214 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:a691337e:::existing_61:head# 2026-02-18T01:19:11.214 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.214 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:a6e8d7ac:::existing_28:head# 2026-02-18T01:19:11.214 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:a9fde86e:::existing_18:head# 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:aa309faa:::existing_68:head# 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:ae40b0ed:::existing_31:head# 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:b279b1fe:::existing_10:head# 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:b343e277:::existing_88:head# 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:b7130e90:::existing_80:head# 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:bc6f7309:::existing_70:head# 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:be8489b7:::existing_38:head# 2026-02-18T01:19:11.215 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:beb4e5e3:::existing_47:head# 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:bebec877:::existing_74:head# 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:c04347d8:::existing_60:head# 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:c156033e:::existing_100:head# 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:c19f5a8e:::existing_8:head# 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:c3e6ebe4:::existing_17:head# 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:c6c5a7c2:::existing_39:head# 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:cc1d0abf:::existing_95:head# 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:ccb3865b:::existing_73:head# 2026-02-18T01:19:11.216 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.217 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:cd84e19e:::existing_40:head# 2026-02-18T01:19:11.217 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.217 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:d2cd64ce:::existing_37:head# 2026-02-18T01:19:11.217 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.217 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:d41a25c9:::existing_22:head# 2026-02-18T01:19:11.217 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.217 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:d7f088da:::existing_91:head# 2026-02-18T01:19:11.217 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.217 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:d9cbd1d6:::existing_64:head# 2026-02-18T01:19:11.217 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.217 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:dcc4ff82:::existing_98:head# 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:dd677bd3:::existing_35:head# 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:dd6d90e7:::existing_46:head# 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:e0e22077:::existing_21:head# 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:e255b710:::existing_55:head# 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:eff1d5db:::existing_14:head# 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:f1b156bf:::existing_23:head# 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.218 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:f5ce4199:::existing_34:head# 2026-02-18T01:19:11.219 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.219 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:f6809456:::existing_11:head# 2026-02-18T01:19:11.219 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.219 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:f699a2a9:::existing_67:head# 2026-02-18T01:19:11.219 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.219 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:f9baac43:::existing_25:head# 2026-02-18T01:19:11.219 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.219 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:fb76688e:::existing_51:head# 2026-02-18T01:19:11.219 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.219 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:fbb92eec:::existing_69:head# 2026-02-18T01:19:11.219 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:19:11.219 INFO:tasks.workunit.client.0.trial080.stdout:write_pg epoch 47 info 1.0( v 47'102 lc 0'0 (29'90,47'102] local-lis/les=46/47 n=101 ec=20/20 lis/c=46/20 les/c/f=47/21/0 sis=46) 2026-02-18T01:19:11.220 INFO:tasks.workunit.client.0.trial080.stdout:Import successful 2026-02-18T01:19:11.342 INFO:tasks.workunit.client.0.trial080.stdout:reviving divergent 1 2026-02-18T01:19:11.342 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:579: TEST_divergent_2: echo 'reviving divergent 1' 2026-02-18T01:19:11.342 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:580: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:19:11.543 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:19:11.543 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 peering 2026-02-18T01:19:09.222324+0000 29'106 46:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:19:11.543 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:19:11.543 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:19:11.544 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:19:11.554 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:581: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-18T01:19:11.554 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:19:11.554 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:19:11.554 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:19:11.554 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:19:11.554 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-18T01:19:11.554 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:19:11.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:19:11.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:19:11.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:19:11.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-18T01:19:11.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-18T01:19:11.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:19:11.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:19:11.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:19:11.555 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:19:11.555 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:19:11.555 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:19:11.555 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:19:11.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:19:11.557 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-18T01:19:11.557 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:19:11.558 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:19:11.558 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:19:11.558 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-18T01:19:11.558 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:19:11.558 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:19:11.558 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:19:11.559 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:19:11.580 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:11.573+0000 7f0ef06e6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:11.582 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:11.577+0000 7f0ef06e6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:11.583 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:11.577+0000 7f0ef06e6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:11.776 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T01:19:11.776 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:19:11.776 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:19:11.776 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:19:11.776 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:19:11.776 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:11.777 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:19:11.777 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:19:11.778 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:11.778 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:19:11.991 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:11.985+0000 7f0ef06e6a40 -1 Falling back to public interface 2026-02-18T01:19:11.992 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/2987097470,v1:127.0.0.1:6819/2987097470] [v2:127.0.0.1:6820/2987097470,v1:127.0.0.1:6821/2987097470] exists,up 24dc2c71-9b2f-48eb-8710-5374b5af4325 2026-02-18T01:19:11.993 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:19:11.993 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:19:11.993 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:19:11.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: wait_for_osd up 1 2026-02-18T01:19:11.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:19:11.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:19:11.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:19:11.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:19:11.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:11.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:19:11.994 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:19:11.995 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:11.995 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:19:12.205 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/2987097470,v1:127.0.0.1:6819/2987097470] [v2:127.0.0.1:6820/2987097470,v1:127.0.0.1:6821/2987097470] exists,up 24dc2c71-9b2f-48eb-8710-5374b5af4325 2026-02-18T01:19:12.206 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:19:12.206 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:19:12.206 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:19:12.206 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:584: TEST_divergent_2: sleep 20 2026-02-18T01:19:12.754 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:12.749+0000 7f0ef06e6a40 -1 osd.1 47 log_to_monitors true 2026-02-18T01:19:32.207 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: get_asok_path osd.1 2026-02-18T01:19:32.207 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T01:19:32.207 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T01:19:32.207 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:19:32.207 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:32.207 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:32.207 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.1.asok 2026-02-18T01:19:32.208 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: CEPH_ARGS= 2026-02-18T01:19:32.208 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.1.asok dump_ops_in_flight 2026-02-18T01:19:32.270 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:19:32.270 INFO:tasks.workunit.client.0.trial080.stdout: "ops": [], 2026-02-18T01:19:32.270 INFO:tasks.workunit.client.0.trial080.stdout: "num_ops": 0 2026-02-18T01:19:32.270 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:19:32.275 INFO:tasks.workunit.client.0.trial080.stdout:allowing recovery 2026-02-18T01:19:32.275 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: echo 'allowing recovery' 2026-02-18T01:19:32.275 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:588: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:19:32.485 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:19:32.486 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-18T01:19:13.847065+0000 47'102 51:166 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:04:11.620776+0000 0 0 2026-02-18T01:19:32.486 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:19:32.486 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:19:32.486 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:19:32.494 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-18T01:19:32.494 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-18T01:19:32.564 INFO:tasks.workunit.client.0.trial080.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-18T01:19:32.572 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-18T01:19:32.572 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-18T01:19:32.657 INFO:tasks.workunit.client.0.trial080.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-18T01:19:32.667 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-18T01:19:32.667 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-18T01:19:32.738 INFO:tasks.workunit.client.0.trial080.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-18T01:19:32.745 INFO:tasks.workunit.client.0.trial080.stdout:reading divergent objects 2026-02-18T01:19:32.746 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:595: TEST_divergent_2: echo 'reading divergent objects' 2026-02-18T01:19:32.746 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: ceph pg dump pgs 2026-02-18T01:19:32.957 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:19:32.957 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-18T01:19:13.847065+0000 47'102 51:166 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:17:33.176951+0000 0'0 2026-02-18T01:17:33.176951+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:04:11.620776+0000 0 0 2026-02-18T01:19:32.957 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:19:32.957 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:19:32.958 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:19:32.969 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: expr 2 + 2 2026-02-18T01:19:32.970 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: seq 1 4 2026-02-18T01:19:32.970 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:19:32.971 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_1 td/divergent-priors/existing 2026-02-18T01:19:33.000 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:19:33.000 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_2 td/divergent-priors/existing 2026-02-18T01:19:33.029 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:19:33.029 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_3 td/divergent-priors/existing 2026-02-18T01:19:33.058 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:19:33.058 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_4 td/divergent-priors/existing 2026-02-18T01:19:33.086 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: seq 1 2 2026-02-18T01:19:33.087 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-18T01:19:33.087 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-18T01:19:33.107 INFO:tasks.workunit.client.0.trial080.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-18T01:19:33.108 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-18T01:19:33.108 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-18T01:19:33.135 INFO:tasks.workunit.client.0.trial080.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-18T01:19:33.137 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:605: TEST_divergent_2: rm -f td/divergent-priors/existing 2026-02-18T01:19:33.138 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-18T01:19:33.140 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-18T01:19:33.142 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-18T01:17:47.330300+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 20 _merge_object_divergent_entries: keeping 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-18T01:17:47.330300+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 29'4 first_divergent_update: 29'106 last_divergent_update: 29'106 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: more recent entry found: 41'101 (29'4) modify 1:70b3bf12:::existing_4:head by client.4658.0:1 2026-02-18T01:18:32.919988+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 29'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4539.0:1 2026-02-18T01:17:47.323063+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 20 _merge_object_divergent_entries: keeping 29'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4539.0:1 2026-02-18T01:17:47.323063+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 29'101 last_divergent_update: 29'101 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-18T01:17:47.327094+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 20 _merge_object_divergent_entries: keeping 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-18T01:17:47.327094+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 29'3 first_divergent_update: 29'105 last_divergent_update: 29'105 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 29'106 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-18T01:17:47.327094+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 29'3 <= info.log_tail 29'90 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-18T01:17:47.323719+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 20 _merge_object_divergent_entries: keeping 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-18T01:17:47.323719+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 29'2 first_divergent_update: 29'104 last_divergent_update: 29'104 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 29'106 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-18T01:17:47.323719+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 29'2 <= info.log_tail 29'90 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 29'102 (29'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-18T01:17:47.323020+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:19:33.143 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 20 _merge_object_divergent_entries: keeping 29'102 (29'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-18T01:17:47.323020+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 29'1 first_divergent_update: 29'102 last_divergent_update: 29'102 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 29'106 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 29'102 (29'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-18T01:17:47.323020+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 29'1 <= info.log_tail 29'90 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 29'103 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4542.0:1 2026-02-18T01:17:47.323360+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 20 _merge_object_divergent_entries: keeping 29'103 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4542.0:1 2026-02-18T01:17:47.323360+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 29'103 last_divergent_update: 29'103 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:19:09.673+0000 7f8eab1b0640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-18T01:19:33.144 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-18T01:19:33.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-18T01:19:33.148 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-18T01:19:33.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-18T01:19:33.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:620: TEST_divergent_2: echo success 2026-02-18T01:19:33.153 INFO:tasks.workunit.client.0.trial080.stdout:success 2026-02-18T01:19:33.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:622: TEST_divergent_2: rm td/divergent-priors/td/divergent-priors/exp.16037.out 2026-02-18T01:19:33.153 INFO:tasks.workunit.client.0.trial080.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.16037.out': No such file or directory 2026-02-18T01:19:33.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:623: TEST_divergent_2: delete_pool test 2026-02-18T01:19:33.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-18T01:19:33.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-18T01:19:33.451 INFO:tasks.workunit.client.0.trial080.stderr:pool 'test' does not exist 2026-02-18T01:19:33.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:624: TEST_divergent_2: kill_daemons td/divergent-priors 2026-02-18T01:19:33.461 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:19:33.461 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:19:33.461 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:19:33.461 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:19:33.461 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:19:38.777 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:19:38.777 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-18T01:19:38.777 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-18T01:19:38.777 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:19:38.778 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-18T01:19:38.778 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:19:38.778 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:19:38.778 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:19:38.778 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:19:38.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:19:38.784 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:19:38.785 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:19:38.786 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:19:38.786 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:19:38.788 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:19:38.788 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:19:38.788 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:19:38.789 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:19:38.789 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:19:38.790 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:19:38.790 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:19:38.791 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:19:38.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:19:38.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-18T01:19:38.813 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:19:38.813 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:38.813 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:38.814 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16037 2026-02-18T01:19:38.815 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:19:38.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:19:38.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-18T01:19:38.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-18T01:19:38.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-18T01:19:38.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-18T01:19:38.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-18T01:19:38.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:19:38.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-18T01:19:38.816 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:19:38.817 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:19:38.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:19:38.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:19:38.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:19:38.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:19:38.818 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:19:38.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:19:38.819 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:19:38.820 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:19:38.820 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:19:38.820 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:19:38.822 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:19:38.822 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:19:38.822 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:19:38.822 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:19:38.823 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:19:38.824 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:19:38.825 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-18T01:19:38.826 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:19:38.826 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:38.826 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:38.826 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16037 2026-02-18T01:19:38.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:19:38.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:19:38.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-18T01:19:38.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:19:38.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:38.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:38.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16037 2026-02-18T01:19:38.830 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:19:38.831 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T01:19:38.831 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:19:38.832 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-18T01:19:38.832 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_3 td/divergent-priors 2026-02-18T01:19:38.832 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:630: TEST_divergent_3: local dir=td/divergent-priors 2026-02-18T01:19:38.832 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: file_with_random_data 2026-02-18T01:19:38.832 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=512 2026-02-18T01:19:38.832 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-18T01:19:38.833 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.f0qNOgUfmd 2026-02-18T01:19:38.833 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.f0qNOgUfmd bs=512 count=1 2026-02-18T01:19:38.834 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records in 2026-02-18T01:19:38.834 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records out 2026-02-18T01:19:38.835 INFO:tasks.workunit.client.0.trial080.stderr:512 bytes copied, 0.000265787 s, 1.9 MB/s 2026-02-18T01:19:38.835 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.f0qNOgUfmd 2026-02-18T01:19:38.835 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: local dummyfile=/tmp/tmp.f0qNOgUfmd 2026-02-18T01:19:38.835 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: file_with_random_data 1000 2026-02-18T01:19:38.836 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=1000 2026-02-18T01:19:38.836 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-18T01:19:38.837 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.bkuxPuJzPP 2026-02-18T01:19:38.837 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.bkuxPuJzPP bs=1000 count=1 2026-02-18T01:19:38.838 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records in 2026-02-18T01:19:38.838 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records out 2026-02-18T01:19:38.838 INFO:tasks.workunit.client.0.trial080.stderr:1000 bytes (1.0 kB) copied, 0.000103424 s, 9.7 MB/s 2026-02-18T01:19:38.838 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.bkuxPuJzPP 2026-02-18T01:19:38.839 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: local dummyfile2=/tmp/tmp.bkuxPuJzPP 2026-02-18T01:19:38.839 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:636: TEST_divergent_3: local num_osds=3 2026-02-18T01:19:38.839 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: expr 3 - 1 2026-02-18T01:19:38.840 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: seq 0 2 2026-02-18T01:19:38.842 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: local 'osds=0 2026-02-18T01:19:38.842 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:19:38.842 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:19:38.842 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: run_mon td/divergent-priors a 2026-02-18T01:19:38.842 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-18T01:19:38.842 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:19:38.842 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:19:38.842 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:19:38.842 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-18T01:19:38.843 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-18T01:19:38.866 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:19:38.866 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:19:38.866 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:19:38.866 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:19:38.866 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:38.866 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:38.866 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:19:38.867 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T01:19:38.896 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:19:38.897 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:19:38.897 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:19:38.897 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:19:38.897 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:19:38.898 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:19:38.899 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:19:38.899 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:19:38.899 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:19:38.899 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:19:38.899 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:38.899 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:38.899 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-mon.a.asok 2026-02-18T01:19:38.899 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:19:38.899 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16037/ceph-mon.a.asok config get fsid 2026-02-18T01:19:38.953 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:19:38.953 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:19:38.953 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:19:38.953 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:19:38.953 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:19:38.954 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:19:38.954 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:19:38.954 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:19:38.954 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:19:38.954 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:38.954 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:38.954 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-mon.a.asok 2026-02-18T01:19:38.955 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:19:38.955 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16037/ceph-mon.a.asok config get mon_host 2026-02-18T01:19:39.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:639: TEST_divergent_3: run_mgr td/divergent-priors x 2026-02-18T01:19:39.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-18T01:19:39.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:19:39.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T01:19:39.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:19:39.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-18T01:19:39.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:19:39.125 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:19:39.126 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:19:39.126 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:19:39.126 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:19:39.126 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:39.126 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:39.126 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:19:39.127 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:19:39.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:19:39.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-18T01:19:39.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 0 2026-02-18T01:19:39.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-18T01:19:39.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:19:39.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:19:39.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:19:39.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-18T01:19:39.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:19:39.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:19:39.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:19:39.151 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:19:39.151 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-18T01:19:39.151 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-18T01:19:39.151 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:19:39.151 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:19:39.151 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:19:39.151 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:19:39.151 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:19:39.151 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:19:39.151 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:19:39.151 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:39.151 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:39.152 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:19:39.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:19:39.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:19:39.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:19:39.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:19:39.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:19:39.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:19:39.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:19:39.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:19:39.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:19:39.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:19:39.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:19:39.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:19:39.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-18T01:19:39.153 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:19:39.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3b89a71a-a4f1-42bd-8e61-3912fd1ab000 2026-02-18T01:19:39.154 INFO:tasks.workunit.client.0.trial080.stdout:add osd0 3b89a71a-a4f1-42bd-8e61-3912fd1ab000 2026-02-18T01:19:39.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 3b89a71a-a4f1-42bd-8e61-3912fd1ab000' 2026-02-18T01:19:39.154 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:19:39.163 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCrE5VpXFaBCRAAMgzBUEfUOtEtuMcqHCpVrw== 2026-02-18T01:19:39.163 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCrE5VpXFaBCRAAMgzBUEfUOtEtuMcqHCpVrw=="}' 2026-02-18T01:19:39.163 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3b89a71a-a4f1-42bd-8e61-3912fd1ab000 -i td/divergent-priors/0/new.json 2026-02-18T01:19:39.280 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:19:39.288 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-18T01:19:39.289 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCrE5VpXFaBCRAAMgzBUEfUOtEtuMcqHCpVrw== --osd-uuid 3b89a71a-a4f1-42bd-8e61-3912fd1ab000 2026-02-18T01:19:39.307 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:39.301+0000 7fe8641d4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:39.309 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:39.301+0000 7fe8641d4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:39.310 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:39.305+0000 7fe8641d4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:39.310 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:39.305+0000 7fe8641d4a40 -1 bdev(0x55eab8226c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:19:39.311 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:39.305+0000 7fe8641d4a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-18T01:19:40.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-18T01:19:40.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:19:40.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:19:40.062 INFO:tasks.workunit.client.0.trial080.stdout:adding osd0 key to auth repository 2026-02-18T01:19:40.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:19:40.184 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:19:40.185 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:19:40.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:19:40.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:19:40.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:19:40.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:19:40.214 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:40.209+0000 7f157cd00a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:40.216 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:40.209+0000 7f157cd00a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:40.218 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:40.213+0000 7f157cd00a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:40.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:19:40.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:19:40.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:19:40.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:19:40.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:19:40.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:40.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:19:40.296 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:19:40.296 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:40.296 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:19:40.403 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:19:40.775 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:40.769+0000 7f157cd00a40 -1 Falling back to public interface 2026-02-18T01:19:41.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:19:41.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:41.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:19:41.405 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:19:41.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:41.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:19:41.613 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:19:41.731 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:41.725+0000 7f157cd00a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:19:42.615 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:19:42.615 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:42.616 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:19:42.616 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:19:42.616 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:42.617 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:19:42.824 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2151488293,v1:127.0.0.1:6801/2151488293] [v2:127.0.0.1:6802/2151488293,v1:127.0.0.1:6803/2151488293] exists,up 3b89a71a-a4f1-42bd-8e61-3912fd1ab000 2026-02-18T01:19:42.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:19:42.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:19:42.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:19:42.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-18T01:19:42.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 1 2026-02-18T01:19:42.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-18T01:19:42.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:19:42.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T01:19:42.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:19:42.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-18T01:19:42.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:19:42.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:19:42.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:19:42.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:19:42.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-18T01:19:42.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-18T01:19:42.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:19:42.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:19:42.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:19:42.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:19:42.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:19:42.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:19:42.829 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:19:42.829 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:42.829 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:42.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:19:42.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:19:42.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:19:42.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:19:42.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:19:42.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:19:42.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:19:42.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:19:42.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:19:42.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:19:42.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:19:42.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:19:42.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:19:42.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-18T01:19:42.830 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:19:42.831 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d10c729f-55e4-4fdd-a451-d20ff188766b 2026-02-18T01:19:42.831 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 d10c729f-55e4-4fdd-a451-d20ff188766b' 2026-02-18T01:19:42.831 INFO:tasks.workunit.client.0.trial080.stdout:add osd1 d10c729f-55e4-4fdd-a451-d20ff188766b 2026-02-18T01:19:42.832 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:19:42.842 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCuE5Vp1+n4MRAAzMi94juEKiLHJCWhy6uOXw== 2026-02-18T01:19:42.842 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCuE5Vp1+n4MRAAzMi94juEKiLHJCWhy6uOXw=="}' 2026-02-18T01:19:42.842 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d10c729f-55e4-4fdd-a451-d20ff188766b -i td/divergent-priors/1/new.json 2026-02-18T01:19:43.056 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:19:43.064 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-18T01:19:43.065 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCuE5Vp1+n4MRAAzMi94juEKiLHJCWhy6uOXw== --osd-uuid d10c729f-55e4-4fdd-a451-d20ff188766b 2026-02-18T01:19:43.085 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:43.077+0000 7fe2e8744a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:43.086 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:43.081+0000 7fe2e8744a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:43.087 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:43.081+0000 7fe2e8744a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:43.088 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:43.081+0000 7fe2e8744a40 -1 bdev(0x55d1b0cd0c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-18T01:19:43.088 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:43.081+0000 7fe2e8744a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-18T01:19:43.756 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-18T01:19:43.756 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:19:43.757 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T01:19:43.757 INFO:tasks.workunit.client.0.trial080.stdout:adding osd1 key to auth repository 2026-02-18T01:19:43.758 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:19:44.045 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:19:44.046 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T01:19:44.046 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:19:44.046 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:19:44.047 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:19:44.047 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:19:44.075 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:44.069+0000 7f2bc2e7ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:44.077 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:44.069+0000 7f2bc2e7ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:44.078 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:44.073+0000 7f2bc2e7ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:44.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T01:19:44.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:19:44.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:19:44.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:19:44.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:19:44.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:44.260 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:19:44.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:19:44.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:44.261 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:19:44.423 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:44.417+0000 7f2bc2e7ca40 -1 Falling back to public interface 2026-02-18T01:19:44.473 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:19:45.039 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:45.033+0000 7f2bc2e7ca40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:19:45.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:19:45.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:45.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:19:45.476 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:19:45.476 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:45.476 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:19:45.688 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/981457532,v1:127.0.0.1:6811/981457532] [v2:127.0.0.1:6812/981457532,v1:127.0.0.1:6813/981457532] exists,up d10c729f-55e4-4fdd-a451-d20ff188766b 2026-02-18T01:19:45.691 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:19:45.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:19:45.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:19:45.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-18T01:19:45.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 2 2026-02-18T01:19:45.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-18T01:19:45.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:19:45.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T01:19:45.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:19:45.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-18T01:19:45.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:19:45.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:19:45.693 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:19:45.694 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:19:45.694 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:19:45.694 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:19:45.694 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:19:45.694 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:19:45.694 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:19:45.694 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:19:45.694 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:19:45.694 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:19:45.694 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:19:45.694 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:19:45.694 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:19:45.695 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:19:45.695 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-18T01:19:45.695 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:19:45.695 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f291872b-2be6-43af-bb27-4d3ad388962b 2026-02-18T01:19:45.696 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 f291872b-2be6-43af-bb27-4d3ad388962b' 2026-02-18T01:19:45.696 INFO:tasks.workunit.client.0.trial080.stdout:add osd2 f291872b-2be6-43af-bb27-4d3ad388962b 2026-02-18T01:19:45.696 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:19:45.706 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCxE5VpxmTjKRAANKDkSvUR63zbCD3e8TXOWw== 2026-02-18T01:19:45.707 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCxE5VpxmTjKRAANKDkSvUR63zbCD3e8TXOWw=="}' 2026-02-18T01:19:45.707 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f291872b-2be6-43af-bb27-4d3ad388962b -i td/divergent-priors/2/new.json 2026-02-18T01:19:45.929 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:19:45.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-18T01:19:45.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCxE5VpxmTjKRAANKDkSvUR63zbCD3e8TXOWw== --osd-uuid f291872b-2be6-43af-bb27-4d3ad388962b 2026-02-18T01:19:45.958 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:45.953+0000 7f1421cf2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:45.959 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:45.953+0000 7f1421cf2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:45.960 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:45.953+0000 7f1421cf2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:45.961 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:45.953+0000 7f1421cf2a40 -1 bdev(0x55fb4cfd4c00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-18T01:19:45.961 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:45.953+0000 7f1421cf2a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-18T01:19:46.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-18T01:19:46.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:19:46.645 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T01:19:46.645 INFO:tasks.workunit.client.0.trial080.stdout:adding osd2 key to auth repository 2026-02-18T01:19:46.645 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:19:46.941 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:19:46.942 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T01:19:46.942 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:19:46.942 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:19:46.943 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:19:46.943 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:19:46.959 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:46.953+0000 7f187006ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:46.961 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:46.953+0000 7f187006ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:46.961 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:46.957+0000 7f187006ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:19:47.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T01:19:47.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:19:47.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:19:47.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:19:47.161 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:19:47.161 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:47.161 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:19:47.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:19:47.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:47.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:19:47.323 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:47.317+0000 7f187006ba40 -1 Falling back to public interface 2026-02-18T01:19:47.371 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:19:47.987 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:19:47.981+0000 7f187006ba40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:19:48.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:19:48.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:48.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:19:48.374 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:19:48.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:48.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:19:48.591 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:19:49.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:19:49.593 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:19:49.593 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:19:49.593 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:19:49.594 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:19:49.594 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:19:49.806 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1401168078,v1:127.0.0.1:6819/1401168078] [v2:127.0.0.1:6820/1401168078,v1:127.0.0.1:6821/1401168078] exists,up f291872b-2be6-43af-bb27-4d3ad388962b 2026-02-18T01:19:49.807 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:19:49.807 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:19:49.807 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:19:49.807 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:645: TEST_divergent_3: ceph osd set noout 2026-02-18T01:19:50.101 INFO:tasks.workunit.client.0.trial080.stderr:noout is set 2026-02-18T01:19:50.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:646: TEST_divergent_3: ceph osd set noin 2026-02-18T01:19:50.406 INFO:tasks.workunit.client.0.trial080.stderr:noin is set 2026-02-18T01:19:50.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:647: TEST_divergent_3: ceph osd set nodown 2026-02-18T01:19:50.710 INFO:tasks.workunit.client.0.trial080.stderr:nodown is set 2026-02-18T01:19:50.720 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:648: TEST_divergent_3: create_pool test 1 1 2026-02-18T01:19:50.720 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-18T01:19:50.965 INFO:tasks.workunit.client.0.trial080.stderr:pool 'test' already exists 2026-02-18T01:19:50.976 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T01:19:51.977 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:649: TEST_divergent_3: ceph osd pool set test size 3 2026-02-18T01:19:52.287 INFO:tasks.workunit.client.0.trial080.stderr:set pool 1 size to 3 2026-02-18T01:19:52.298 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:650: TEST_divergent_3: ceph osd pool set test min_size 2 2026-02-18T01:19:52.591 INFO:tasks.workunit.client.0.trial080.stderr:set pool 1 min_size to 2 2026-02-18T01:19:52.602 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:653: TEST_divergent_3: ceph osd pool set test pg_autoscale_mode on 2026-02-18T01:19:52.896 INFO:tasks.workunit.client.0.trial080.stderr:set pool 1 pg_autoscale_mode to on 2026-02-18T01:19:52.908 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:655: TEST_divergent_3: divergent=-1 2026-02-18T01:19:52.909 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: date +%s 2026-02-18T01:19:52.910 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: start_time=1771377592 2026-02-18T01:19:52.910 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: max_duration=300 2026-02-18T01:19:52.910 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' -1 -le -1 ']' 2026-02-18T01:19:52.910 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: flush_pg_stats 2026-02-18T01:19:52.910 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:19:52.911 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:19:53.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:19:53.126 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:19:53.126 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:19:53.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:19:53.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:19:53.126 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:19:53.209 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-18T01:19:53.209 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-18T01:19:53.209 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485' 2026-02-18T01:19:53.209 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:19:53.209 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:19:53.293 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-18T01:19:53.294 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-18T01:19:53.294 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-18T01:19:53.294 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:19:53.294 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:19:53.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509443 2026-02-18T01:19:53.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509443 2026-02-18T01:19:53.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-42949672964 2-64424509443' 2026-02-18T01:19:53.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:19:53.374 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-18T01:19:53.374 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:19:53.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:19:53.375 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836485 2026-02-18T01:19:53.376 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:19:53.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836485 2026-02-18T01:19:53.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-18T01:19:53.377 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836485 2026-02-18T01:19:53.378 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:19:53.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-18T01:19:53.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:19:53.605 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-18T01:19:53.605 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:19:53.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:19:53.607 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672964 2026-02-18T01:19:53.607 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:19:53.608 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672964 2026-02-18T01:19:53.608 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 42949672964 2026-02-18T01:19:53.609 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-18T01:19:53.609 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:19:53.823 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-18T01:19:53.823 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:19:53.824 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509443 2026-02-18T01:19:53.824 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:19:53.825 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:19:53.826 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-64424509443 2026-02-18T01:19:53.826 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:19:53.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=64424509443 2026-02-18T01:19:53.827 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 64424509443 2026-02-18T01:19:53.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-18T01:19:53.828 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:19:54.047 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509441 -lt 64424509443 2026-02-18T01:19:54.047 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:19:55.048 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:19:55.048 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:19:55.267 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509441 -lt 64424509443 2026-02-18T01:19:55.267 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:19:56.268 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T01:19:56.268 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:19:56.483 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509444 -lt 64424509443 2026-02-18T01:19:56.483 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:662: TEST_divergent_3: wait_for_clean 2026-02-18T01:19:56.483 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:19:56.483 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:19:56.483 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:19:56.483 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:19:56.484 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:19:56.484 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:19:56.484 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:19:56.485 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:19:56.485 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:19:56.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:19:56.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:19:56.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:19:56.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:19:56.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:19:56.592 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:19:56.813 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:19:56.814 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:19:56.814 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:19:56.814 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:19:56.814 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:19:56.814 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:19:56.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-18T01:19:56.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-18T01:19:56.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-18T01:19:56.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:19:56.898 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:19:56.977 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672967 2026-02-18T01:19:56.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672967 2026-02-18T01:19:56.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-42949672967' 2026-02-18T01:19:56.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:19:56.978 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:19:57.057 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509446 2026-02-18T01:19:57.057 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509446 2026-02-18T01:19:57.057 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-42949672967 2-64424509446' 2026-02-18T01:19:57.057 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:19:57.058 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-18T01:19:57.058 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:19:57.059 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:19:57.060 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-18T01:19:57.060 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:19:57.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-18T01:19:57.062 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836487 2026-02-18T01:19:57.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-18T01:19:57.063 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:19:57.272 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-18T01:19:57.272 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:19:58.273 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:19:58.273 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:19:58.489 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-18T01:19:58.489 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:19:58.490 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672967 2026-02-18T01:19:58.490 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:19:58.491 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:19:58.492 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672967 2026-02-18T01:19:58.492 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:19:58.493 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672967 2026-02-18T01:19:58.493 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 42949672967 2026-02-18T01:19:58.494 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2026-02-18T01:19:58.494 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:19:58.708 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672967 -lt 42949672967 2026-02-18T01:19:58.708 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:19:58.709 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509446 2026-02-18T01:19:58.709 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:19:58.709 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:19:58.710 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-64424509446 2026-02-18T01:19:58.710 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:19:58.712 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=64424509446 2026-02-18T01:19:58.712 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2026-02-18T01:19:58.712 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 64424509446 2026-02-18T01:19:58.712 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:19:58.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509446 -lt 64424509446 2026-02-18T01:19:58.939 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:19:58.940 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:19:58.940 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:19:59.222 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:19:59.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:19:59.223 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:19:59.223 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:19:59.223 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:19:59.223 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:19:59.223 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:19:59.223 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:19:59.435 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-18T01:19:59.436 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:19:59.436 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:19:59.436 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:19:59.721 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-18T01:19:59.721 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:19:59.722 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:19:59.722 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: ceph pg dump pgs --format=json 2026-02-18T01:19:59.722 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: jq '.pg_stats[0].up_primary' 2026-02-18T01:19:59.921 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:19:59.931 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: divergent=1 2026-02-18T01:19:59.931 INFO:tasks.workunit.client.0.trial080.stdout:primary and soon to be divergent is 1 2026-02-18T01:19:59.932 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:666: TEST_divergent_3: echo 'primary and soon to be divergent is 1' 2026-02-18T01:19:59.932 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:667: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:20:00.134 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:20:00.135 INFO:tasks.workunit.client.0.trial080.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T01:19:51.131547+0000 0'0 31:22 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:48:59.870234+0000 0 0 2026-02-18T01:20:00.135 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:20:00.135 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:20:00.135 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:20:00.145 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: date +%s 2026-02-18T01:20:00.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: current_time=1771377600 2026-02-18T01:20:00.146 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: expr 1771377600 - 1771377592 2026-02-18T01:20:00.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: elapsed_time=8 2026-02-18T01:20:00.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: '[' 8 -gt 300 ']' 2026-02-18T01:20:00.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' 1 -le -1 ']' 2026-02-18T01:20:00.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:677: TEST_divergent_3: local non_divergent= 2026-02-18T01:20:00.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-18T01:20:00.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 0 = 1 ']' 2026-02-18T01:20:00.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0' 2026-02-18T01:20:00.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-18T01:20:00.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 1 = 1 ']' 2026-02-18T01:20:00.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: continue 2026-02-18T01:20:00.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-18T01:20:00.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 2 = 1 ']' 2026-02-18T01:20:00.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0 2' 2026-02-18T01:20:00.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: echo 'writing initial objects' 2026-02-18T01:20:00.150 INFO:tasks.workunit.client.0.trial080.stdout:writing initial objects 2026-02-18T01:20:00.151 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: seq 1 100 2026-02-18T01:20:00.151 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.151 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.172 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.172 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.195 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.195 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_3 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.218 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.218 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.239 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.239 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_5 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_6 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.279 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.279 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_7 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.301 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.301 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_8 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.329 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.330 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_9 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_10 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.371 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.371 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_11 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.390 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.390 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_12 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.410 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.410 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_13 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_14 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_15 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.476 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.476 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_16 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.499 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.499 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_17 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.528 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.528 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_18 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.547 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.548 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_19 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.573 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.573 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_20 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.597 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.597 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_21 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.619 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.619 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_22 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.648 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.648 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_23 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.675 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.675 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_24 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.695 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.695 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_25 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.724 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.724 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_26 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_27 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.780 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_28 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.806 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.807 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_29 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.835 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.835 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_30 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.863 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.863 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_31 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_32 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.911 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.911 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_33 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_34 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_35 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:00.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:00.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_36 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_37 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.047 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.047 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_38 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.075 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.075 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_39 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.101 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.101 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_40 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.120 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.120 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_41 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_42 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_43 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.196 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.196 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_44 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.224 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.224 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_45 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.251 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.251 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_46 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.279 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.279 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_47 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.307 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_48 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.334 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.334 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_49 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.355 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.355 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_50 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_51 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.403 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.403 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_52 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_53 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.454 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.454 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_54 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.482 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.482 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_55 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.510 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.510 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_56 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.539 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.539 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_57 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.567 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.567 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_58 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.594 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.594 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_59 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.622 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.622 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_60 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.650 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.650 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_61 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_62 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.706 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.706 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_63 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.734 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.735 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_64 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.762 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.763 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_65 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.790 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.790 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_66 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.809 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.809 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_67 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.839 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.839 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_68 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.867 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.867 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_69 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_70 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.916 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.916 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_71 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.943 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.943 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_72 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.971 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.971 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_73 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:01.999 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:01.999 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_74 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_75 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_76 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.082 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.083 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_77 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_78 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_79 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.166 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.166 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_80 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.195 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.195 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_81 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_82 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.250 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.250 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_83 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.278 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.279 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_84 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.307 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.307 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_85 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.335 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.362 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_86 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.362 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.363 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_87 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_88 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.411 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.412 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_89 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.439 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.440 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_90 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_91 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.495 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.495 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_92 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_93 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.551 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.551 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_94 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.579 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.579 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_95 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_96 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.635 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.635 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_97 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.664 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_98 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.691 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_99 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.720 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-18T01:20:02.721 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_100 /tmp/tmp.f0qNOgUfmd 2026-02-18T01:20:02.742 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-18T01:20:02.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: wait_for_clean 2026-02-18T01:20:02.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:20:02.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:20:02.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:20:02.743 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-18T01:20:02.744 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:20:02.744 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:20:02.744 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:20:02.744 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:20:02.744 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:20:02.812 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-18T01:20:02.812 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:20:02.813 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:20:02.813 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:20:02.813 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:20:02.813 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:20:03.029 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:20:03.030 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:20:03.030 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:20:03.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:20:03.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:20:03.030 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:20:03.108 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-18T01:20:03.108 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-18T01:20:03.108 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491' 2026-02-18T01:20:03.108 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:20:03.108 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:20:03.191 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672970 2026-02-18T01:20:03.191 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672970 2026-02-18T01:20:03.191 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-42949672970' 2026-02-18T01:20:03.191 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:20:03.191 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:20:03.272 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509449 2026-02-18T01:20:03.273 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509449 2026-02-18T01:20:03.273 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-42949672970 2-64424509449' 2026-02-18T01:20:03.273 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:20:03.273 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-18T01:20:03.274 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:20:03.274 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:20:03.275 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836491 2026-02-18T01:20:03.275 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:20:03.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836491 2026-02-18T01:20:03.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-18T01:20:03.277 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836491 2026-02-18T01:20:03.277 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:20:03.497 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-18T01:20:03.497 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:20:03.498 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672970 2026-02-18T01:20:03.498 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:20:03.498 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:20:03.499 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672970 2026-02-18T01:20:03.499 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:20:03.501 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672970 2026-02-18T01:20:03.501 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-18T01:20:03.501 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 42949672970 2026-02-18T01:20:03.502 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:20:03.730 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672970 -lt 42949672970 2026-02-18T01:20:03.730 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:20:03.731 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509449 2026-02-18T01:20:03.731 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:20:03.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:20:03.733 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-64424509449 2026-02-18T01:20:03.733 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:20:03.734 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=64424509449 2026-02-18T01:20:03.734 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 64424509449' 2026-02-18T01:20:03.735 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 64424509449 2026-02-18T01:20:03.735 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:20:03.947 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509449 -lt 64424509449 2026-02-18T01:20:03.948 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:20:03.948 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:03.948 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:04.239 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:20:04.239 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:04.240 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:04.241 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:04.241 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:04.241 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:04.241 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:04.241 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:04.456 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-18T01:20:04.457 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:04.457 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:04.458 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:04.738 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-18T01:20:04.738 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:20:04.738 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:20:04.739 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: get_pg test existing_1 2026-02-18T01:20:04.739 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-18T01:20:04.739 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-18T01:20:04.739 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-18T01:20:04.739 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-18T01:20:04.949 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: local pgid=1.0 2026-02-18T01:20:04.950 INFO:tasks.workunit.client.0.trial080.stdout:blackholing osds 0 2 2026-02-18T01:20:04.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: echo 'blackholing osds 0 2' 2026-02-18T01:20:04.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:699: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:20:05.148 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:20:05.148 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-18T01:19:51.131547+0000 31'100 31:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:48:59.870234+0000 0 0 2026-02-18T01:20:05.148 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:20:05.148 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:20:05.149 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:20:05.158 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-18T01:20:05.159 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.0 2026-02-18T01:20:05.159 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T01:20:05.159 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T01:20:05.160 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:20:05.160 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:20:05.160 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:20:05.160 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.0.asok 2026-02-18T01:20:05.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-18T01:20:05.161 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-18T01:20:05.223 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:20:05.223 INFO:tasks.workunit.client.0.trial080.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-18T01:20:05.223 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:20:05.229 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-18T01:20:05.230 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.2 2026-02-18T01:20:05.230 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-18T01:20:05.230 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-18T01:20:05.230 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:20:05.230 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:20:05.230 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:20:05.231 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.2.asok 2026-02-18T01:20:05.231 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-18T01:20:05.231 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-18T01:20:05.283 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:20:05.284 INFO:tasks.workunit.client.0.trial080.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-18T01:20:05.284 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:20:05.289 INFO:tasks.workunit.client.0.trial080.stdout:create new divergent objects 2026-02-18T01:20:05.290 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:706: TEST_divergent_3: echo 'create new divergent objects' 2026-02-18T01:20:05.290 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: seq 1 2 2026-02-18T01:20:05.291 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-18T01:20:05.291 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-18T01:20:05.291 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_1 2026-02-18T01:20:05.291 INFO:tasks.workunit.client.0.trial080.stdout:writing divergent objects 2026-02-18T01:20:05.292 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:712: TEST_divergent_3: echo 'writing divergent objects' 2026-02-18T01:20:05.292 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_2 2026-02-18T01:20:05.292 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: seq 1 2 2026-02-18T01:20:05.293 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-18T01:20:05.293 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-18T01:20:05.293 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.bkuxPuJzPP 2026-02-18T01:20:05.293 INFO:tasks.workunit.client.0.trial080.stdout:remove divergent objects 2026-02-18T01:20:05.294 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:718: TEST_divergent_3: echo 'remove divergent objects' 2026-02-18T01:20:05.294 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.bkuxPuJzPP 2026-02-18T01:20:05.294 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: seq 1 2 2026-02-18T01:20:05.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-18T01:20:05.295 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 1 + 2 2026-02-18T01:20:05.296 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=3 2026-02-18T01:20:05.297 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-18T01:20:05.297 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_3 2026-02-18T01:20:05.297 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 2 + 2 2026-02-18T01:20:05.298 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=4 2026-02-18T01:20:05.298 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:724: TEST_divergent_3: sleep 10 2026-02-18T01:20:05.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_4 2026-02-18T01:20:15.300 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:725: TEST_divergent_3: killall -9 rados 2026-02-18T01:20:15.355 INFO:tasks.workunit.client.0.trial080.stderr:rados: no process found 2026-02-18T01:20:15.356 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: echo 'killing all the osds' 2026-02-18T01:20:15.356 INFO:tasks.workunit.client.0.trial080.stdout:killing all the osds 2026-02-18T01:20:15.356 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:20:15.561 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:20:15.562 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-18T01:19:51.131547+0000 31'106 31:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:48:59.870234+0000 0 0 2026-02-18T01:20:15.562 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:20:15.562 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:20:15.562 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:20:15.572 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:730: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd 2026-02-18T01:20:15.573 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:20:15.573 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:20:15.573 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:20:15.573 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:20:15.573 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:20:15.682 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:20:15.682 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-18T01:20:15.682 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.0 2026-02-18T01:20:15.941 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already down. 2026-02-18T01:20:15.953 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-18T01:20:15.953 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.1 2026-02-18T01:20:16.220 INFO:tasks.workunit.client.0.trial080.stderr:osd.1 is already down. 2026-02-18T01:20:16.229 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-18T01:20:16.230 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.2 2026-02-18T01:20:16.509 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already down. 2026-02-18T01:20:16.519 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-18T01:20:16.519 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.0 2026-02-18T01:20:16.796 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already out. 2026-02-18T01:20:16.807 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-18T01:20:16.807 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.2 2026-02-18T01:20:17.071 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already out. 2026-02-18T01:20:17.082 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: echo 'bringing up non_divergent 0 2' 2026-02-18T01:20:17.083 INFO:tasks.workunit.client.0.trial080.stdout:bringing up non_divergent 0 2 2026-02-18T01:20:17.083 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:742: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:20:17.291 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:20:17.292 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-18T01:19:51.131547+0000 31'106 31:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:48:59.870234+0000 0 0 2026-02-18T01:20:17.292 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:20:17.292 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:20:17.292 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:20:17.303 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-18T01:20:17.303 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 0 2026-02-18T01:20:17.303 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:20:17.303 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:20:17.303 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:20:17.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:20:17.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-18T01:20:17.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:20:17.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:20:17.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:20:17.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:20:17.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-18T01:20:17.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-18T01:20:17.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:20:17.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:20:17.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:20:17.304 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:20:17.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:20:17.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:20:17.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:20:17.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:20:17.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-18T01:20:17.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:20:17.307 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:20:17.307 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:20:17.308 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-18T01:20:17.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:20:17.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:20:17.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:20:17.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:20:17.332 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:20:17.325+0000 7effa69b0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:20:17.334 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:20:17.329+0000 7effa69b0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:20:17.335 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:20:17.329+0000 7effa69b0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:20:17.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:20:17.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:20:17.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:20:17.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:20:17.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:20:17.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:20:17.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:20:17.523 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:20:17.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:20:17.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:20:17.695 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:20:17.689+0000 7effa69b0a40 -1 Falling back to public interface 2026-02-18T01:20:17.740 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:20:18.400 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:20:18.393+0000 7effa69b0a40 -1 osd.0 31 log_to_monitors true 2026-02-18T01:20:18.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:20:18.742 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:20:18.742 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:20:18.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:20:18.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:20:18.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:20:18.954 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up out weight 0 up_from 38 up_thru 0 down_at 32 last_clean_interval [5,31) [v2:127.0.0.1:6800/3344064271,v1:127.0.0.1:6801/3344064271] [v2:127.0.0.1:6802/3344064271,v1:127.0.0.1:6803/3344064271] exists,up 3b89a71a-a4f1-42bd-8e61-3912fd1ab000 2026-02-18T01:20:18.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:20:18.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:20:18.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:20:18.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-18T01:20:18.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 2 2026-02-18T01:20:18.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:20:18.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:20:18.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T01:20:18.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:20:18.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-18T01:20:18.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:20:18.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:20:18.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:20:18.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:20:18.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-18T01:20:18.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-18T01:20:18.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:20:18.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:20:18.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:20:18.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:20:18.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:20:18.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:20:18.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:20:18.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:20:18.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-18T01:20:18.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T01:20:18.961 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:20:18.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:20:18.962 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-18T01:20:18.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T01:20:18.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:20:18.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:20:18.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:20:18.980 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:20:18.973+0000 7fb5781f8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:20:18.981 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:20:18.977+0000 7fb5781f8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:20:18.982 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:20:18.977+0000 7fb5781f8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:20:19.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T01:20:19.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:20:19.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:20:19.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:20:19.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:20:19.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:20:19.181 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:20:19.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:20:19.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:20:19.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:20:19.367 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:20:19.361+0000 7fb5781f8a40 -1 Falling back to public interface 2026-02-18T01:20:19.393 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:20:20.024 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:20:20.017+0000 7fb5781f8a40 -1 osd.2 31 log_to_monitors true 2026-02-18T01:20:20.395 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:20:20.395 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:20:20.395 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:20:20.395 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:20:20.396 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:20:20.396 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:20:20.603 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up out weight 0 up_from 40 up_thru 0 down_at 34 last_clean_interval [15,31) [v2:127.0.0.1:6810/4118971596,v1:127.0.0.1:6811/4118971596] [v2:127.0.0.1:6812/4118971596,v1:127.0.0.1:6813/4118971596] exists,up f291872b-2be6-43af-bb27-4d3ad388962b 2026-02-18T01:20:20.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:20:20.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:20:20.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:20:20.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-18T01:20:20.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.0 2026-02-18T01:20:20.868 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already in. 2026-02-18T01:20:20.879 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-18T01:20:20.879 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.2 2026-02-18T01:20:21.147 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already in. 2026-02-18T01:20:21.156 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-18T01:20:21.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: wait_for_clean 2026-02-18T01:20:21.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:20:21.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:20:21.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:20:21.157 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-18T01:20:21.158 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:20:21.158 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:20:21.158 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:20:21.158 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:20:21.158 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:20:21.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-18T01:20:21.224 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:20:21.224 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:20:21.224 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:20:21.224 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:20:21.224 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:20:21.442 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:20:21.442 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:20:21.442 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:20:21.442 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:20:21.442 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:20:21.442 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:20:21.528 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-18T01:20:21.528 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-18T01:20:21.529 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-163208757251' 2026-02-18T01:20:21.529 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:20:21.529 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:20:21.588 INFO:tasks.workunit.client.0.trial080.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-18T01:20:21.591 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-18T01:20:21.591 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-18T01:20:21.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-18T01:20:21.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:20:21.592 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:20:21.670 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691843 2026-02-18T01:20:21.670 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691843 2026-02-18T01:20:21.670 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-163208757251 2-171798691843' 2026-02-18T01:20:21.670 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:20:21.671 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-163208757251 2026-02-18T01:20:21.671 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:20:21.672 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:20:21.672 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-163208757251 2026-02-18T01:20:21.672 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:20:21.674 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757251 2026-02-18T01:20:21.674 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 163208757251 2026-02-18T01:20:21.675 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 163208757251' 2026-02-18T01:20:21.675 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:20:21.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 163208757251 2026-02-18T01:20:21.890 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:20:22.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:20:22.891 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:20:23.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 163208757251 2026-02-18T01:20:23.111 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:20:24.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T01:20:24.112 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:20:24.334 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-18T01:20:24.334 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:20:24.335 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-171798691843 2026-02-18T01:20:24.335 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:20:24.336 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:20:24.337 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-171798691843 2026-02-18T01:20:24.337 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:20:24.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=171798691843 2026-02-18T01:20:24.338 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 171798691843 2026-02-18T01:20:24.339 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 171798691843' 2026-02-18T01:20:24.339 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:20:24.548 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 171798691843 -lt 171798691843 2026-02-18T01:20:24.549 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:20:24.549 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:24.549 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:24.840 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:20:24.840 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:24.841 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:24.841 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:24.841 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:24.841 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:24.841 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:24.841 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:25.048 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:25.048 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:25.048 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:25.048 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:25.326 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:20:25.327 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-18T01:20:25.327 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-18T01:20:25.327 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-18T01:20:25.327 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:25.327 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-18T01:20:25.427 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:20:25.427 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:25.428 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:25.428 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:25.428 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:25.428 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:25.428 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:25.429 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:25.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:25.645 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:25.645 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:25.646 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:25.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:20:25.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:20:25.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:20:25.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:20:25.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:20:25.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:20:25.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:20:25.936 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:20:25.937 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:20:26.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:20:26.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:20:26.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-18T01:20:26.224 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:26.224 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-18T01:20:26.424 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:20:26.424 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:26.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:26.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:26.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:26.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:26.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:26.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:26.640 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:26.641 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:26.641 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:26.642 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:26.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:20:26.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:20:26.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:20:26.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:20:26.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:20:26.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:20:26.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:20:26.939 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:20:26.939 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:20:27.221 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:20:27.221 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:20:27.221 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-18T01:20:27.221 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:27.221 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-18T01:20:27.623 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:20:27.623 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:27.624 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:27.624 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:27.624 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:27.624 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:27.624 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:27.624 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:27.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:27.838 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:27.839 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:27.839 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:28.128 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:20:28.128 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:20:28.128 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:20:28.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:20:28.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:20:28.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:20:28.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:20:28.129 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:20:28.129 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:20:28.412 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:20:28.412 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:20:28.412 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-18T01:20:28.412 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:28.412 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-18T01:20:29.213 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:20:29.213 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:29.214 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:29.214 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:29.215 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:29.215 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:29.215 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:29.215 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:29.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:29.431 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:29.432 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:29.432 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:29.710 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:20:29.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:20:29.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:20:29.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:20:29.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:20:29.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:20:29.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:20:29.711 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:20:29.712 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:20:29.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:20:29.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:20:29.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-18T01:20:29.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:29.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-18T01:20:31.594 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:20:31.594 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:31.595 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:31.595 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:31.595 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:31.595 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:31.595 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:31.595 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:31.806 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:31.807 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:31.807 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:31.807 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:32.087 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:20:32.087 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:20:32.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:20:32.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:20:32.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:20:32.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:20:32.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:20:32.089 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:20:32.089 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:20:32.368 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:20:32.368 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:20:32.368 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-18T01:20:32.368 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:32.368 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-18T01:20:35.569 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:20:35.569 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:35.570 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:35.570 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:35.570 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:35.570 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:35.570 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:35.570 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:35.780 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:35.780 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:35.781 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:35.781 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:36.059 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:20:36.059 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:20:36.059 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:20:36.059 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:20:36.059 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:20:36.059 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:20:36.059 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:20:36.059 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:20:36.060 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:20:36.345 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:20:36.345 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:20:36.345 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-18T01:20:36.345 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:36.345 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-18T01:20:42.746 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:20:42.746 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:42.747 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:42.747 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:42.747 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:42.747 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:42.747 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:42.747 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:42.957 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:42.957 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:42.958 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:42.958 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:43.245 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:20:43.245 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:20:43.245 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:20:43.245 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:20:43.246 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:20:43.246 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:20:43.246 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:20:43.246 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:20:43.246 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:20:43.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:20:43.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:20:43.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-18T01:20:43.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:43.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-18T01:20:50.831 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:20:50.831 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:50.832 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:50.832 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:50.833 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:50.833 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:50.833 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:50.833 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:51.044 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:51.045 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:51.045 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:51.045 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:51.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-18T01:20:51.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:20:51.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:20:51.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:20:51.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:20:51.325 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:20:51.325 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:20:51.325 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:20:51.325 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:20:51.611 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:20:51.611 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:20:51.611 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-18T01:20:51.612 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-18T01:20:51.883 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:20:51.884 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_fingerprint": "f91972bd-c86b-4749-aaf5-7a6cb05fc90e", 2026-02-18T01:20:51.884 INFO:tasks.workunit.client.0.trial080.stdout: "version": "20.2.0-670-gadc19233", 2026-02-18T01:20:51.884 INFO:tasks.workunit.client.0.trial080.stdout: "commit": "adc1923395f2bcd6ae89b5d331d278364d1848ed", 2026-02-18T01:20:51.884 INFO:tasks.workunit.client.0.trial080.stdout: "timestamp": "2026-02-18T01:20:51.879222+0000", 2026-02-18T01:20:51.884 INFO:tasks.workunit.client.0.trial080.stdout: "tag": "", 2026-02-18T01:20:51.884 INFO:tasks.workunit.client.0.trial080.stdout: "health": { 2026-02-18T01:20:51.884 INFO:tasks.workunit.client.0.trial080.stdout: "status": "HEALTH_WARN", 2026-02-18T01:20:51.884 INFO:tasks.workunit.client.0.trial080.stdout: "checks": { 2026-02-18T01:20:51.884 INFO:tasks.workunit.client.0.trial080.stdout: "OSDMAP_FLAGS": { 2026-02-18T01:20:51.884 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:20:51.885 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:20:51.885 INFO:tasks.workunit.client.0.trial080.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-18T01:20:51.885 INFO:tasks.workunit.client.0.trial080.stdout: "count": 17 2026-02-18T01:20:51.885 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.885 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [], 2026-02-18T01:20:51.885 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:20:51.885 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.885 INFO:tasks.workunit.client.0.trial080.stdout: "OSD_DOWN": { 2026-02-18T01:20:51.885 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:20:51.885 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:20:51.885 INFO:tasks.workunit.client.0.trial080.stdout: "message": "1 osds down", 2026-02-18T01:20:51.885 INFO:tasks.workunit.client.0.trial080.stdout: "count": 1 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: "message": "osd.1 (root=default,host=trial080) is down" 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: "PG_DEGRADED": { 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-18T01:20:51.886 INFO:tasks.workunit.client.0.trial080.stdout: "count": 32 2026-02-18T01:20:51.887 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.887 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:20:51.887 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.887 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.0 is active+undersized+degraded+wait, acting [0,2]" 2026-02-18T01:20:51.887 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.887 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.887 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.887 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.887 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.887 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.887 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.887 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.888 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.888 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.888 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.888 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.888 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.888 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.888 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.888 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.888 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.888 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.888 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.888 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.889 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.889 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.889 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.889 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.889 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.889 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.889 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.889 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.889 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.890 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.891 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.892 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.893 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.894 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: "mutes": [] 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_first_committed": 1, 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_last_committed": 1, 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: "monmap": { 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:19:38.854908Z", 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:19:38.854908Z", 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release": 20, 2026-02-18T01:20:51.895 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release_name": "tentacle", 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "election_strategy": 1, 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "disallowed_leaders": "", 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": false, 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "tiebreaker_mon": "", 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "removed_ranks": "", 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "features": { 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "persistent": [ 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "kraken", 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "luminous", 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "mimic", 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap-prune", 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "nautilus", 2026-02-18T01:20:51.896 INFO:tasks.workunit.client.0.trial080.stdout: "octopus", 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: "pacific", 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: "elector-pinging", 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: "quincy", 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: "reef", 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: "squid", 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: "tentacle", 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: "nvmeof_beacon_diff" 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: "optional": [] 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: "mons": [ 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: "rank": 0, 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: "name": "a", 2026-02-18T01:20:51.897 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115", 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 0 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115/0", 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: "priority": 0, 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 0, 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: "crush_location": "{}" 2026-02-18T01:20:51.898 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: "quorum": [ 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: 0 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap": { 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 46, 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:19:38.939892+0000", 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:20:43.496085+0000", 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: "last_up_change": "2026-02-18T01:20:20.176082+0000", 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: "last_in_change": "2026-02-18T01:20:21.086731+0000", 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: "flags_num": 5800384, 2026-02-18T01:20:51.899 INFO:tasks.workunit.client.0.trial080.stdout: "flags_set": [ 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "nodown", 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "noin", 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "noout", 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "pglog_hardlimit", 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snapdirs", 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "recovery_deletes", 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "sortbitwise" 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "crush_version": 9, 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "full_ratio": 0.99000000953674316, 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_snapshot": "", 2026-02-18T01:20:51.900 INFO:tasks.workunit.client.0.trial080.stdout: "pool_max": 1, 2026-02-18T01:20:51.901 INFO:tasks.workunit.client.0.trial080.stdout: "max_osd": 3, 2026-02-18T01:20:51.901 INFO:tasks.workunit.client.0.trial080.stdout: "require_min_compat_client": "luminous", 2026-02-18T01:20:51.901 INFO:tasks.workunit.client.0.trial080.stdout: "min_compat_client": "jewel", 2026-02-18T01:20:51.901 INFO:tasks.workunit.client.0.trial080.stdout: "require_osd_release": "tentacle", 2026-02-18T01:20:51.901 INFO:tasks.workunit.client.0.trial080.stdout: "allow_crimson": false, 2026-02-18T01:20:51.901 INFO:tasks.workunit.client.0.trial080.stdout: "pools": [ 2026-02-18T01:20:51.901 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.901 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:20:51.901 INFO:tasks.workunit.client.0.trial080.stdout: "pool_name": "test", 2026-02-18T01:20:51.901 INFO:tasks.workunit.client.0.trial080.stdout: "create_time": "2026-02-18T01:19:50.883461+0000", 2026-02-18T01:20:51.901 INFO:tasks.workunit.client.0.trial080.stdout: "flags": 1, 2026-02-18T01:20:51.902 INFO:tasks.workunit.client.0.trial080.stdout: "flags_names": "hashpspool", 2026-02-18T01:20:51.902 INFO:tasks.workunit.client.0.trial080.stdout: "type": 1, 2026-02-18T01:20:51.902 INFO:tasks.workunit.client.0.trial080.stdout: "size": 3, 2026-02-18T01:20:51.902 INFO:tasks.workunit.client.0.trial080.stdout: "min_size": 2, 2026-02-18T01:20:51.902 INFO:tasks.workunit.client.0.trial080.stdout: "crush_rule": 0, 2026-02-18T01:20:51.902 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_count": 0, 2026-02-18T01:20:51.902 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_target": 0, 2026-02-18T01:20:51.902 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_barrier": 0, 2026-02-18T01:20:51.903 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-18T01:20:51.903 INFO:tasks.workunit.client.0.trial080.stdout: "is_stretch_pool": false, 2026-02-18T01:20:51.903 INFO:tasks.workunit.client.0.trial080.stdout: "object_hash": 2, 2026-02-18T01:20:51.903 INFO:tasks.workunit.client.0.trial080.stdout: "pg_autoscale_mode": "on", 2026-02-18T01:20:51.903 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num": 32, 2026-02-18T01:20:51.903 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num": 1, 2026-02-18T01:20:51.903 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num_target": 32, 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_target": 32, 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_pending": 32, 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "last_pg_merge_meta": { 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "source_pgid": "0.0", 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "ready_epoch": 0, 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_started": 0, 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": 0, 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "source_version": "0'0", 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "target_version": "0'0" 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "last_change": "45", 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend": "0", 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_preluminous": "45", 2026-02-18T01:20:51.904 INFO:tasks.workunit.client.0.trial080.stdout: "auid": 0, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "snap_mode": "selfmanaged", 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "snap_seq": 0, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "snap_epoch": 0, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "pool_snaps": [], 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps": "[]", 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_bytes": 0, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_objects": 0, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "tiers": [], 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "tier_of": -1, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "read_tier": -1, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "write_tier": -1, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "cache_mode": "none", 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_bytes": 0, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_objects": 0, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-18T01:20:51.905 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_flush_age": 0, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_evict_age": 0, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profile": "", 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_params": { 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "type": "none" 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_period": 0, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_count": 0, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "use_gmt_hitset": true, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "min_read_recency_for_promote": 0, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "min_write_recency_for_promote": 0, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_grade_decay_rate": 0, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_search_last_n": 0, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "grade_table": [], 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "stripe_width": 0, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "expected_num_objects": 0, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "fast_read": false, 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "nonprimary_shards": "{}", 2026-02-18T01:20:51.906 INFO:tasks.workunit.client.0.trial080.stdout: "options": {}, 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "application_metadata": {}, 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "read_balance": { 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "score_type": "Fair distribution", 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "score_acting": 2.9900000095367432, 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "score_stable": 2.9900000095367432, 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "optimal_score": 0.67000001668930054, 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "raw_score_acting": 2, 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "raw_score_stable": 2, 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity_weighted": 1, 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "average_primary_affinity": 1, 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "average_primary_affinity_weighted": 1 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "osds": [ 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "3b89a71a-a4f1-42bd-8e61-3912fd1ab000", 2026-02-18T01:20:51.907 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 5, 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 31, 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 38, 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 45, 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 32, 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6800", 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6801", 2026-02-18T01:20:51.908 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6802", 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6803", 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.909 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6806", 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6807", 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6804", 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:20:51.910 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6805", 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6801/3344064271", 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6803/3344064271", 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3344064271", 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3344064271", 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "d10c729f-55e4-4fdd-a451-d20ff188766b", 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "up": 0, 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 0, 2026-02-18T01:20:51.911 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 0, 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 10, 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 23, 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 33, 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.912 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:20:51.913 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/981457532", 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/981457532", 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/981457532", 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/981457532", 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: "exists" 2026-02-18T01:20:51.914 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "f291872b-2be6-43af-bb27-4d3ad388962b", 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 15, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 31, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 40, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 0, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 34, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:20:51.915 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.916 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/4118971596", 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/4118971596", 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4118971596", 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4118971596", 2026-02-18T01:20:51.917 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "osd_xinfo": [ 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:20:15.883077+0000", 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:19:42.696507+0000", 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:20:16.159542+0000", 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:19:46.027657+0000", 2026-02-18T01:20:51.918 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:20:16.448413+0000", 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:19:49.000249+0000", 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap": [], 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_items": [], 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_primaries": [], 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "pg_temp": [], 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "primary_temp": [], 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "blocklist": {}, 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "range_blocklist": {}, 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profiles": { 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "default": { 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "k": "2", 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "m": "2", 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "plugin": "isa", 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: "technique": "reed_sol_van" 2026-02-18T01:20:51.919 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps_queue": [], 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "new_removed_snaps": [], 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "new_purged_snaps": [], 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "crush_node_flags": {}, 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "device_class_flags": {}, 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": { 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_enabled": false, 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_bucket_count": 0, 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "degraded_stretch_mode": 0, 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "recovering_stretch_mode": 0, 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_bucket": 0 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "osd_metadata": [ 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6802/3344064271,v1:127.0.0.1:6803/3344064271]", 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:20:51.920 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:19:39.919192Z", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6800/3344064271,v1:127.0.0.1:6801/3344064271]", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:20:51.921 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3344064271,v1:127.0.0.1:6807/3344064271]", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3344064271,v1:127.0.0.1:6805/3344064271]", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/0", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/981457532,v1:127.0.0.1:6813/981457532]", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:20:51.922 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:19:43.637600Z", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:20:51.923 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/981457532,v1:127.0.0.1:6811/981457532]", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/981457532,v1:127.0.0.1:6817/981457532]", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/981457532,v1:127.0.0.1:6815/981457532]", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/1", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/4118971596,v1:127.0.0.1:6813/4118971596]", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:20:51.924 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:19:46.545828Z", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:20:51.925 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/4118971596,v1:127.0.0.1:6811/4118971596]", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4118971596,v1:127.0.0.1:6817/4118971596]", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4118971596,v1:127.0.0.1:6815/4118971596]", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/2", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_clean_epochs": { 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "min_last_epoch_clean": 0, 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": { 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "per_pool": [] 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "osd_epochs": [ 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.926 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 38 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 41 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_first_committed": 1, 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_last_committed": 46, 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "crushmap": { 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "devices": [ 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.0", 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.1", 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.2", 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "types": [ 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.927 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 0, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd" 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "name": "host" 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 2, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "name": "chassis" 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 3, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "name": "rack" 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 4, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "name": "row" 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 5, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pdu" 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 6, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pod" 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 7, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "name": "room" 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.928 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 8, 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: "name": "datacenter" 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 9, 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: "name": "zone" 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 10, 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: "name": "region" 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stderr:report 2731776354 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: "name": "root" 2026-02-18T01:20:51.929 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "buckets": [ 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "id": -1, 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default", 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "id": -2, 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default~ssd", 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:20:51.930 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080", 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080~ssd", 2026-02-18T01:20:51.931 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "rules": [ 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "rule_id": 0, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "rule_name": "replicated_rule", 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "type": 1, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "steps": [ 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "op": "take", 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "item": -1, 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: "item_name": "default" 2026-02-18T01:20:51.932 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "op": "choose_firstn", 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "num": 0, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "type": "osd" 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "op": "emit" 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "tunables": { 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_tries": 0, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_fallback_tries": 0, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "choose_total_tries": 50, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_descend_once": 1, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_vary_r": 1, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_stable": 1, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "msr_descents": 100, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "msr_collision_tries": 100, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "straw_calc_version": 1, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "allowed_bucket_algs": 54, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "profile": "jewel", 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "optimal_tunables": 1, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "legacy_tunables": 0, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "minimum_required_version": "jewel", 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables": 1, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables2": 1, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "has_v2_rules": 0, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables3": 1, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "has_v3_rules": 0, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "has_v4_buckets": 1, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables5": 1, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "has_v5_rules": 0, 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: "has_msr_rules": 0 2026-02-18T01:20:51.933 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "choose_args": {} 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "fsmap": { 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "btime": "2026-02-18T01:19:38:939684+0000", 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "default_fscid": -1, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "compat": { 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "compat": {}, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "ro_compat": {}, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "incompat": { 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "feature_1": "base v0.20", 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "feature_2": "client writeable ranges", 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "feature_3": "default file layouts on dirs", 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "feature_4": "dir inode in separate object", 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "feature_5": "mds uses versioned encoding", 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "feature_8": "no anchor table", 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "feature_9": "file layout v2", 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "feature_10": "snaprealm v2", 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "feature_11": "minor log segments", 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "feature_12": "quiesce subvolumes" 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "feature_flags": { 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "enable_multiple": true, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "ever_enabled_multiple": true 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "standbys": [], 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "filesystems": [] 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_first_committed": 1, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_last_committed": 1, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "auth": { 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 5, 2026-02-18T01:20:51.934 INFO:tasks.workunit.client.0.trial080.stdout: "num_secrets": 3 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 32, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_active": 32, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_unknown": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_osd": 3, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "pool_sum": { 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 51200, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 100, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 300, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 100, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 100, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 100, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 100, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:20:51.935 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 512, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 512, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "up": 64, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 64, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 0 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum": { 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 65, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:20:51.936 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 83984, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2200, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 26, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 81701, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314488816, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322036547584, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2252800, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 464130, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 27363, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 83662109 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 0, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum_by_class": { 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "ssd": { 2026-02-18T01:20:51.937 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 65, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 83984, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2200, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 26, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 81701, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314488816, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322036547584, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2252800, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 464130, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 27363, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 83662109 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 0, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:20:51.938 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "pool_stats": [ 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": 1, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 32, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 51200, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 100, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 300, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 100, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 100, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 100, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 100, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:20:51.939 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 1220608, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 153552, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 512, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 512, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "up": 64, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 64, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 3 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "osd_stats": [ 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 163208757257 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 42949672972 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.940 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 171798691849 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_state": [ 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "state": "active+undersized+degraded", 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num": 31 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "state": "active+undersized+degraded+wait", 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num": 1 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "pool_pg_unavailable_map": [ 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": "1", 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "pgs": [] 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_osd": [ 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 32, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 32, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 32, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 0, 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.941 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": [ 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": {} 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "servicemap": { 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 3, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:20:47.362439+0000", 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "services": { 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "osd": { 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "daemons": { 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "summary": "", 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "0": { 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "start_epoch": 0, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "start_stamp": "0.000000", 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "gid": 0, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "metadata": {}, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "task_status": {} 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "2": { 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "start_epoch": 0, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "start_stamp": "0.000000", 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "gid": 0, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "metadata": {}, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "task_status": {} 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_first_committed": 1, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_last_committed": 37, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "logm_first_committed": 1, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "logm_last_committed": 223, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "paxos": { 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 317, 2026-02-18T01:20:51.942 INFO:tasks.workunit.client.0.trial080.stdout: "last_pn": 0, 2026-02-18T01:20:51.943 INFO:tasks.workunit.client.0.trial080.stdout: "accepted_pn": 0 2026-02-18T01:20:51.943 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:20:51.943 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:20:51.943 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-18T01:20:51.943 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: expr 2 + 2 2026-02-18T01:20:51.943 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: objname=existing_4 2026-02-18T01:20:51.943 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:756: TEST_divergent_3: echo 'writing non-divergent object existing_4' 2026-02-18T01:20:51.943 INFO:tasks.workunit.client.0.trial080.stdout:writing non-divergent object existing_4 2026-02-18T01:20:51.943 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:757: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.508062+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.509720+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506556+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506438+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506488+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506388+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506144+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.510006+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507906+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507319+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.508766+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507673+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506301+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506838+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506074+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506125+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded+wait 2026-02-18T01:20:43.501698+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507846+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506421+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506787+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506735+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506594+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507791+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.100 INFO:tasks.workunit.client.0.trial080.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506340+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.101 INFO:tasks.workunit.client.0.trial080.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506349+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.101 INFO:tasks.workunit.client.0.trial080.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506358+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.101 INFO:tasks.workunit.client.0.trial080.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506357+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.101 INFO:tasks.workunit.client.0.trial080.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506860+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.101 INFO:tasks.workunit.client.0.trial080.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506883+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.101 INFO:tasks.workunit.client.0.trial080.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507553+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.101 INFO:tasks.workunit.client.0.trial080.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507167+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.101 INFO:tasks.workunit.client.0.trial080.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507597+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:20:52.101 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:20:52.101 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:20:52.101 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:20:52.109 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.bkuxPuJzPP 2026-02-18T01:20:52.141 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-18T01:20:52.142 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: wait_for_clean 2026-02-18T01:20:52.142 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:20:52.142 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:20:52.142 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:20:52.142 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-18T01:20:52.142 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:20:52.142 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:20:52.143 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:20:52.143 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:20:52.143 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:20:52.213 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-18T01:20:52.213 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:20:52.213 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:20:52.214 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:20:52.214 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:20:52.214 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:20:52.438 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:20:52.439 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:20:52.439 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:20:52.439 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:20:52.439 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:20:52.439 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:20:52.521 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757259 2026-02-18T01:20:52.521 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757259 2026-02-18T01:20:52.521 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-163208757259' 2026-02-18T01:20:52.521 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:20:52.521 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:20:52.580 INFO:tasks.workunit.client.0.trial080.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-18T01:20:52.584 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-18T01:20:52.584 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-18T01:20:52.584 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-18T01:20:52.584 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:20:52.585 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:20:52.661 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691851 2026-02-18T01:20:52.661 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691851 2026-02-18T01:20:52.661 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-163208757259 2-171798691851' 2026-02-18T01:20:52.662 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:20:52.662 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-163208757259 2026-02-18T01:20:52.662 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:20:52.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:20:52.663 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-163208757259 2026-02-18T01:20:52.664 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:20:52.665 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757259 2026-02-18T01:20:52.665 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 163208757259' 2026-02-18T01:20:52.665 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 163208757259 2026-02-18T01:20:52.666 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:20:52.893 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757257 -lt 163208757259 2026-02-18T01:20:52.893 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:20:53.894 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:20:53.894 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:20:54.115 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757259 -lt 163208757259 2026-02-18T01:20:54.115 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:20:54.115 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-171798691851 2026-02-18T01:20:54.116 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:20:54.117 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:20:54.117 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-171798691851 2026-02-18T01:20:54.117 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:20:54.118 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=171798691851 2026-02-18T01:20:54.119 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 171798691851 2026-02-18T01:20:54.119 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 171798691851' 2026-02-18T01:20:54.119 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:20:54.332 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 171798691851 -lt 171798691851 2026-02-18T01:20:54.333 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:20:54.334 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:54.334 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:54.612 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-18T01:20:54.612 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:54.612 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:54.612 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:54.613 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:54.613 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:54.613 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:54.613 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:54.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:54.828 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:54.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:54.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:55.118 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-18T01:20:55.118 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-18T01:20:55.118 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-18T01:20:55.118 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-18T01:20:55.118 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:55.118 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-18T01:20:55.219 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:20:55.219 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:55.219 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:55.219 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:55.219 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:55.220 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:55.220 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:55.220 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:55.435 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:55.435 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:55.435 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:55.436 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:55.720 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-18T01:20:55.720 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:20:55.720 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:20:55.720 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:20:55.720 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:20:55.720 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:20:55.720 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:20:55.720 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:20:55.720 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:20:56.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:20:56.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:20:56.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-18T01:20:56.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:56.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-18T01:20:56.205 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:20:56.205 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:56.206 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:56.206 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:56.206 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:56.207 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:56.207 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:56.207 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:56.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:56.417 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:56.417 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:56.417 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:56.697 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-18T01:20:56.697 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:20:56.697 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:20:56.697 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:20:56.697 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:20:56.697 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:20:56.697 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:20:56.697 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:20:56.697 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:20:56.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:20:56.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:20:56.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-18T01:20:56.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:56.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-18T01:20:57.379 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:20:57.379 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:57.379 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:57.379 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:57.379 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:57.379 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:57.380 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:57.380 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:57.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:57.593 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:57.593 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:57.593 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:57.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-18T01:20:57.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:20:57.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:20:57.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:20:57.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:20:57.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:20:57.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:20:57.870 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:20:57.871 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:20:58.147 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:20:58.148 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:20:58.148 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-18T01:20:58.148 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:58.148 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-18T01:20:58.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:20:58.948 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:20:58.948 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:20:58.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:20:58.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:20:58.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:20:58.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:20:58.949 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:20:59.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:20:59.157 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:20:59.158 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:20:59.158 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:20:59.450 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-18T01:20:59.450 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:20:59.450 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:20:59.451 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:20:59.451 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:20:59.451 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:20:59.451 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:20:59.451 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:20:59.451 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:20:59.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:20:59.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:20:59.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-18T01:20:59.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:20:59.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-18T01:21:01.348 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:21:01.348 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:21:01.349 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:21:01.349 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:21:01.349 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:21:01.349 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:21:01.349 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:21:01.349 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:21:01.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:21:01.562 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:21:01.563 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:21:01.563 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:21:01.850 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-18T01:21:01.850 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:21:01.850 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:21:01.850 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:21:01.850 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:21:01.850 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:21:01.850 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:21:01.850 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:21:01.850 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:21:02.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:21:02.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:21:02.137 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-18T01:21:02.137 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:21:02.137 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-18T01:21:05.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:21:05.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:21:05.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:21:05.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:21:05.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:21:05.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:21:05.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:21:05.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:21:05.551 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:21:05.552 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:21:05.552 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:21:05.552 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:21:05.839 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-18T01:21:05.839 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:21:05.839 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:21:05.839 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:21:05.839 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:21:05.839 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:21:05.839 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:21:05.840 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:21:05.840 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:21:06.132 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:21:06.132 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:21:06.132 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-18T01:21:06.132 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:21:06.132 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-18T01:21:12.532 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:21:12.532 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:21:12.533 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:21:12.533 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:21:12.533 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:21:12.533 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:21:12.533 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:21:12.533 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:21:12.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:21:12.748 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:21:12.749 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:21:12.749 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:21:13.034 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-18T01:21:13.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:21:13.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:21:13.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:21:13.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:21:13.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:21:13.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:21:13.035 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:21:13.035 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:21:13.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:21:13.325 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:21:13.325 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-18T01:21:13.325 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:21:13.325 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-18T01:21:20.625 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:21:20.625 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:21:20.626 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:21:20.626 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:21:20.626 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:21:20.626 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:21:20.626 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:21:20.626 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:21:20.839 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:21:20.840 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:21:20.840 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:21:20.840 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:21:21.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-18T01:21:21.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:21:21.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:21:21.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:21:21.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:21:21.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:21:21.128 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:21:21.128 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:21:21.128 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:21:21.411 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:21:21.411 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:21:21.411 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-18T01:21:21.411 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-18T01:21:21.684 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:21:21.684 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_fingerprint": "f91972bd-c86b-4749-aaf5-7a6cb05fc90e", 2026-02-18T01:21:21.684 INFO:tasks.workunit.client.0.trial080.stdout: "version": "20.2.0-670-gadc19233", 2026-02-18T01:21:21.685 INFO:tasks.workunit.client.0.trial080.stdout: "commit": "adc1923395f2bcd6ae89b5d331d278364d1848ed", 2026-02-18T01:21:21.685 INFO:tasks.workunit.client.0.trial080.stdout: "timestamp": "2026-02-18T01:21:21.680513+0000", 2026-02-18T01:21:21.685 INFO:tasks.workunit.client.0.trial080.stdout: "tag": "", 2026-02-18T01:21:21.685 INFO:tasks.workunit.client.0.trial080.stdout: "health": { 2026-02-18T01:21:21.685 INFO:tasks.workunit.client.0.trial080.stdout: "status": "HEALTH_WARN", 2026-02-18T01:21:21.685 INFO:tasks.workunit.client.0.trial080.stdout: "checks": { 2026-02-18T01:21:21.685 INFO:tasks.workunit.client.0.trial080.stdout: "OSDMAP_FLAGS": { 2026-02-18T01:21:21.685 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:21:21.685 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:21:21.685 INFO:tasks.workunit.client.0.trial080.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-18T01:21:21.685 INFO:tasks.workunit.client.0.trial080.stdout: "count": 17 2026-02-18T01:21:21.685 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.686 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [], 2026-02-18T01:21:21.686 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:21:21.686 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.686 INFO:tasks.workunit.client.0.trial080.stdout: "OSD_DOWN": { 2026-02-18T01:21:21.686 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:21:21.686 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:21:21.686 INFO:tasks.workunit.client.0.trial080.stdout: "message": "1 osds down", 2026-02-18T01:21:21.686 INFO:tasks.workunit.client.0.trial080.stdout: "count": 1 2026-02-18T01:21:21.686 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.686 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:21:21.686 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.686 INFO:tasks.workunit.client.0.trial080.stdout: "message": "osd.1 (root=default,host=trial080) is down" 2026-02-18T01:21:21.687 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.687 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.687 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:21:21.687 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.687 INFO:tasks.workunit.client.0.trial080.stdout: "PG_DEGRADED": { 2026-02-18T01:21:21.687 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:21:21.687 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:21:21.687 INFO:tasks.workunit.client.0.trial080.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-18T01:21:21.687 INFO:tasks.workunit.client.0.trial080.stdout: "count": 32 2026-02-18T01:21:21.687 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.687 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:21:21.687 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.688 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.688 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.688 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.688 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.688 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.688 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.688 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.688 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.688 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.688 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.688 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.688 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.689 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.689 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.689 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.689 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.689 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.689 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.689 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.689 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.689 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.689 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.689 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.689 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.690 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.690 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.690 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.690 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.690 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.690 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.690 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.690 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.690 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.690 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.690 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.690 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.691 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.692 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.692 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.692 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.692 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.692 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.692 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.692 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.692 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.692 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.692 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.692 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.692 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.693 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.694 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.694 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.694 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.694 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.694 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.694 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.694 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.694 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.694 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.694 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.694 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.694 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.695 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: "mutes": [] 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_first_committed": 1, 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_last_committed": 1, 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: "monmap": { 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:19:38.854908Z", 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:19:38.854908Z", 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release": 20, 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release_name": "tentacle", 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: "election_strategy": 1, 2026-02-18T01:21:21.696 INFO:tasks.workunit.client.0.trial080.stdout: "disallowed_leaders": "", 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": false, 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "tiebreaker_mon": "", 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "removed_ranks": "", 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "features": { 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "persistent": [ 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "kraken", 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "luminous", 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "mimic", 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap-prune", 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "nautilus", 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "octopus", 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "pacific", 2026-02-18T01:21:21.697 INFO:tasks.workunit.client.0.trial080.stdout: "elector-pinging", 2026-02-18T01:21:21.698 INFO:tasks.workunit.client.0.trial080.stdout: "quincy", 2026-02-18T01:21:21.698 INFO:tasks.workunit.client.0.trial080.stdout: "reef", 2026-02-18T01:21:21.698 INFO:tasks.workunit.client.0.trial080.stdout: "squid", 2026-02-18T01:21:21.698 INFO:tasks.workunit.client.0.trial080.stdout: "tentacle", 2026-02-18T01:21:21.698 INFO:tasks.workunit.client.0.trial080.stdout: "nvmeof_beacon_diff" 2026-02-18T01:21:21.698 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.698 INFO:tasks.workunit.client.0.trial080.stdout: "optional": [] 2026-02-18T01:21:21.698 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.698 INFO:tasks.workunit.client.0.trial080.stdout: "mons": [ 2026-02-18T01:21:21.698 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.698 INFO:tasks.workunit.client.0.trial080.stdout: "rank": 0, 2026-02-18T01:21:21.698 INFO:tasks.workunit.client.0.trial080.stdout: "name": "a", 2026-02-18T01:21:21.699 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:21:21.699 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.699 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.699 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.699 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115", 2026-02-18T01:21:21.699 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 0 2026-02-18T01:21:21.699 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.699 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.699 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.699 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115/0", 2026-02-18T01:21:21.699 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-18T01:21:21.699 INFO:tasks.workunit.client.0.trial080.stdout: "priority": 0, 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 0, 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: "crush_location": "{}" 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: "quorum": [ 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: 0 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap": { 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 46, 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:19:38.939892+0000", 2026-02-18T01:21:21.700 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:20:43.496085+0000", 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: "last_up_change": "2026-02-18T01:20:20.176082+0000", 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: "last_in_change": "2026-02-18T01:20:21.086731+0000", 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: "flags_num": 5800384, 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: "flags_set": [ 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: "nodown", 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: "noin", 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: "noout", 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: "pglog_hardlimit", 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snapdirs", 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: "recovery_deletes", 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: "sortbitwise" 2026-02-18T01:21:21.701 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.702 INFO:tasks.workunit.client.0.trial080.stdout: "crush_version": 9, 2026-02-18T01:21:21.702 INFO:tasks.workunit.client.0.trial080.stdout: "full_ratio": 0.99000000953674316, 2026-02-18T01:21:21.702 INFO:tasks.workunit.client.0.trial080.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-18T01:21:21.702 INFO:tasks.workunit.client.0.trial080.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-18T01:21:21.702 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_snapshot": "", 2026-02-18T01:21:21.702 INFO:tasks.workunit.client.0.trial080.stdout: "pool_max": 1, 2026-02-18T01:21:21.702 INFO:tasks.workunit.client.0.trial080.stdout: "max_osd": 3, 2026-02-18T01:21:21.702 INFO:tasks.workunit.client.0.trial080.stdout: "require_min_compat_client": "luminous", 2026-02-18T01:21:21.702 INFO:tasks.workunit.client.0.trial080.stdout: "min_compat_client": "jewel", 2026-02-18T01:21:21.702 INFO:tasks.workunit.client.0.trial080.stdout: "require_osd_release": "tentacle", 2026-02-18T01:21:21.702 INFO:tasks.workunit.client.0.trial080.stdout: "allow_crimson": false, 2026-02-18T01:21:21.702 INFO:tasks.workunit.client.0.trial080.stdout: "pools": [ 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: "pool_name": "test", 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: "create_time": "2026-02-18T01:19:50.883461+0000", 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: "flags": 1, 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: "flags_names": "hashpspool", 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: "type": 1, 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: "size": 3, 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: "min_size": 2, 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: "crush_rule": 0, 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_count": 0, 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_target": 0, 2026-02-18T01:21:21.703 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_barrier": 0, 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "is_stretch_pool": false, 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "object_hash": 2, 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "pg_autoscale_mode": "on", 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num": 32, 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num": 1, 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num_target": 32, 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_target": 32, 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_pending": 32, 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "last_pg_merge_meta": { 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "source_pgid": "0.0", 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "ready_epoch": 0, 2026-02-18T01:21:21.704 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_started": 0, 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": 0, 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: "source_version": "0'0", 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: "target_version": "0'0" 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: "last_change": "45", 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend": "0", 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_preluminous": "45", 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: "auid": 0, 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: "snap_mode": "selfmanaged", 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: "snap_seq": 0, 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: "snap_epoch": 0, 2026-02-18T01:21:21.705 INFO:tasks.workunit.client.0.trial080.stdout: "pool_snaps": [], 2026-02-18T01:21:21.706 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps": "[]", 2026-02-18T01:21:21.706 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_bytes": 0, 2026-02-18T01:21:21.706 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_objects": 0, 2026-02-18T01:21:21.706 INFO:tasks.workunit.client.0.trial080.stdout: "tiers": [], 2026-02-18T01:21:21.706 INFO:tasks.workunit.client.0.trial080.stdout: "tier_of": -1, 2026-02-18T01:21:21.706 INFO:tasks.workunit.client.0.trial080.stdout: "read_tier": -1, 2026-02-18T01:21:21.706 INFO:tasks.workunit.client.0.trial080.stdout: "write_tier": -1, 2026-02-18T01:21:21.706 INFO:tasks.workunit.client.0.trial080.stdout: "cache_mode": "none", 2026-02-18T01:21:21.706 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_bytes": 0, 2026-02-18T01:21:21.706 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_objects": 0, 2026-02-18T01:21:21.706 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-18T01:21:21.706 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_flush_age": 0, 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_evict_age": 0, 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profile": "", 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_params": { 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "type": "none" 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_period": 0, 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_count": 0, 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "use_gmt_hitset": true, 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "min_read_recency_for_promote": 0, 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "min_write_recency_for_promote": 0, 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_grade_decay_rate": 0, 2026-02-18T01:21:21.707 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_search_last_n": 0, 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "grade_table": [], 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "stripe_width": 0, 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "expected_num_objects": 0, 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "fast_read": false, 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "nonprimary_shards": "{}", 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "options": {}, 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "application_metadata": {}, 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "read_balance": { 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "score_type": "Fair distribution", 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "score_acting": 2.9900000095367432, 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "score_stable": 2.9900000095367432, 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "optimal_score": 0.67000001668930054, 2026-02-18T01:21:21.708 INFO:tasks.workunit.client.0.trial080.stdout: "raw_score_acting": 2, 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: "raw_score_stable": 2, 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity_weighted": 1, 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: "average_primary_affinity": 1, 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: "average_primary_affinity_weighted": 1 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: "osds": [ 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "3b89a71a-a4f1-42bd-8e61-3912fd1ab000", 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:21:21.709 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:21:21.710 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:21:21.710 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:21:21.710 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 5, 2026-02-18T01:21:21.710 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 31, 2026-02-18T01:21:21.710 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 38, 2026-02-18T01:21:21.710 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 45, 2026-02-18T01:21:21.710 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 32, 2026-02-18T01:21:21.710 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:21:21.710 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:21:21.710 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.710 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.710 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6800", 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6801", 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.711 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6802", 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6803", 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:21:21.712 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6806", 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6807", 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:21:21.713 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6804", 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6805", 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3344064271 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6801/3344064271", 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6803/3344064271", 2026-02-18T01:21:21.714 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3344064271", 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3344064271", 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "d10c729f-55e4-4fdd-a451-d20ff188766b", 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: "up": 0, 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:21:21.715 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 0, 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 0, 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 10, 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 23, 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 33, 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:21:21.716 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.717 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.718 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 981457532 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/981457532", 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/981457532", 2026-02-18T01:21:21.719 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/981457532", 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/981457532", 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: "exists" 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "f291872b-2be6-43af-bb27-4d3ad388962b", 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 15, 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 31, 2026-02-18T01:21:21.720 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 40, 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 0, 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 34, 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.721 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:21:21.722 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:21:21.723 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 4118971596 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/4118971596", 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/4118971596", 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4118971596", 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4118971596", 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:21:21.724 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: "osd_xinfo": [ 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:20:15.883077+0000", 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:19:42.696507+0000", 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.725 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:20:16.159542+0000", 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:19:46.027657+0000", 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:20:16.448413+0000", 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:19:49.000249+0000", 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.726 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap": [], 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_items": [], 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_primaries": [], 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "pg_temp": [], 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "primary_temp": [], 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "blocklist": {}, 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "range_blocklist": {}, 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profiles": { 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "default": { 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "k": "2", 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "m": "2", 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "plugin": "isa", 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "technique": "reed_sol_van" 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps_queue": [], 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "new_removed_snaps": [], 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "new_purged_snaps": [], 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "crush_node_flags": {}, 2026-02-18T01:21:21.727 INFO:tasks.workunit.client.0.trial080.stdout: "device_class_flags": {}, 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": { 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_enabled": false, 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_bucket_count": 0, 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "degraded_stretch_mode": 0, 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "recovering_stretch_mode": 0, 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_bucket": 0 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "osd_metadata": [ 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6802/3344064271,v1:127.0.0.1:6803/3344064271]", 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:21:21.728 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:19:39.919192Z", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:21:21.729 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6800/3344064271,v1:127.0.0.1:6801/3344064271]", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3344064271,v1:127.0.0.1:6807/3344064271]", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3344064271,v1:127.0.0.1:6805/3344064271]", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:21:21.730 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/0", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/981457532,v1:127.0.0.1:6813/981457532]", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:21:21.731 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:19:43.637600Z", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/981457532,v1:127.0.0.1:6811/981457532]", 2026-02-18T01:21:21.732 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/981457532,v1:127.0.0.1:6817/981457532]", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/981457532,v1:127.0.0.1:6815/981457532]", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/1", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/4118971596,v1:127.0.0.1:6813/4118971596]", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:21:21.733 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:21:21.734 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:19:46.545828Z", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/4118971596,v1:127.0.0.1:6811/4118971596]", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4118971596,v1:127.0.0.1:6817/4118971596]", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4118971596,v1:127.0.0.1:6815/4118971596]", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/2", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:21:21.735 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_clean_epochs": { 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "min_last_epoch_clean": 0, 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": { 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "per_pool": [] 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "osd_epochs": [ 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 38 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 41 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_first_committed": 1, 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_last_committed": 46, 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "crushmap": { 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: "devices": [ 2026-02-18T01:21:21.736 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.0", 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.1", 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.2", 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "types": [ 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 0, 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd" 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: "name": "host" 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.737 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 2, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "name": "chassis" 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 3, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "name": "rack" 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 4, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "name": "row" 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 5, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pdu" 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 6, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pod" 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 7, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "name": "room" 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 8, 2026-02-18T01:21:21.738 INFO:tasks.workunit.client.0.trial080.stdout: "name": "datacenter" 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 9, 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stdout: "name": "zone" 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 10, 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stdout: "name": "region" 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stderr:report 3272598177 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:21:21.739 INFO:tasks.workunit.client.0.trial080.stdout: "name": "root" 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "buckets": [ 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "id": -1, 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default", 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "id": -2, 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default~ssd", 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:21:21.740 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080", 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:21:21.741 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080~ssd", 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:21:21.742 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "rules": [ 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "rule_id": 0, 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "rule_name": "replicated_rule", 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "type": 1, 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "steps": [ 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "op": "take", 2026-02-18T01:21:21.743 INFO:tasks.workunit.client.0.trial080.stdout: "item": -1, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "item_name": "default" 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "op": "choose_firstn", 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "num": 0, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "type": "osd" 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "op": "emit" 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "tunables": { 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_tries": 0, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_fallback_tries": 0, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "choose_total_tries": 50, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_descend_once": 1, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_vary_r": 1, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_stable": 1, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "msr_descents": 100, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "msr_collision_tries": 100, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "straw_calc_version": 1, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "allowed_bucket_algs": 54, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "profile": "jewel", 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "optimal_tunables": 1, 2026-02-18T01:21:21.744 INFO:tasks.workunit.client.0.trial080.stdout: "legacy_tunables": 0, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "minimum_required_version": "jewel", 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables": 1, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables2": 1, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "has_v2_rules": 0, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables3": 1, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "has_v3_rules": 0, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "has_v4_buckets": 1, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables5": 1, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "has_v5_rules": 0, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "has_msr_rules": 0 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "choose_args": {} 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "fsmap": { 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "btime": "2026-02-18T01:19:38:939684+0000", 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "default_fscid": -1, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "compat": { 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "compat": {}, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "ro_compat": {}, 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "incompat": { 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "feature_1": "base v0.20", 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "feature_2": "client writeable ranges", 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "feature_3": "default file layouts on dirs", 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "feature_4": "dir inode in separate object", 2026-02-18T01:21:21.745 INFO:tasks.workunit.client.0.trial080.stdout: "feature_5": "mds uses versioned encoding", 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "feature_8": "no anchor table", 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "feature_9": "file layout v2", 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "feature_10": "snaprealm v2", 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "feature_11": "minor log segments", 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "feature_12": "quiesce subvolumes" 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "feature_flags": { 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "enable_multiple": true, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "ever_enabled_multiple": true 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "standbys": [], 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "filesystems": [] 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_first_committed": 1, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_last_committed": 1, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "auth": { 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 5, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "num_secrets": 3 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 32, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_active": 32, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_unknown": 0, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "num_osd": 3, 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "pool_sum": { 2026-02-18T01:21:21.746 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 51688, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 100, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 300, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 100, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 100, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 101, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 101, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:21:21.747 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 513, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 513, 2026-02-18T01:21:21.748 INFO:tasks.workunit.client.0.trial080.stdout: "up": 64, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 64, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 0 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum": { 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 65, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 83984, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2200, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 26, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 81701, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314488816, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322036547584, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2252800, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 465106, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 27363, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 83662109 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.749 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 0, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum_by_class": { 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "ssd": { 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 65, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 83984, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2200, 2026-02-18T01:21:21.750 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 26, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 81701, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314488816, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322036547584, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2252800, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 465106, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 27363, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 83662109 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 0, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.751 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "pool_stats": [ 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": 1, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 32, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 51688, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 100, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 300, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 100, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 100, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 101, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 101, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:21:21.752 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 1220608, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 154528, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 513, 2026-02-18T01:21:21.753 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 513, 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "up": 64, 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 64, 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 3 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "osd_stats": [ 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 163208757265 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 42949672972 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 171798691857 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_state": [ 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "state": "active+undersized+degraded", 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "num": 32 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "pool_pg_unavailable_map": [ 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": "1", 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "pgs": [] 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.754 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_osd": [ 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 32, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 32, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 32, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 0, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": [ 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": {} 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "servicemap": { 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 5, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:21:21.367951+0000", 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "services": {} 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_first_committed": 1, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_last_committed": 52, 2026-02-18T01:21:21.755 INFO:tasks.workunit.client.0.trial080.stdout: "logm_first_committed": 1, 2026-02-18T01:21:21.756 INFO:tasks.workunit.client.0.trial080.stdout: "logm_last_committed": 283, 2026-02-18T01:21:21.756 INFO:tasks.workunit.client.0.trial080.stdout: "paxos": { 2026-02-18T01:21:21.756 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:21:21.756 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 392, 2026-02-18T01:21:21.756 INFO:tasks.workunit.client.0.trial080.stdout: "last_pn": 0, 2026-02-18T01:21:21.756 INFO:tasks.workunit.client.0.trial080.stdout: "accepted_pn": 0 2026-02-18T01:21:21.756 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:21:21.756 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:21:21.756 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-18T01:21:21.756 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:763: TEST_divergent_3: echo 'delay recovery' 2026-02-18T01:21:21.756 INFO:tasks.workunit.client.0.trial080.stdout:delay recovery 2026-02-18T01:21:21.756 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:764: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:21:21.905 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:21:21.906 INFO:tasks.workunit.client.0.trial080.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.508062+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.906 INFO:tasks.workunit.client.0.trial080.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.509720+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.906 INFO:tasks.workunit.client.0.trial080.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506556+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.906 INFO:tasks.workunit.client.0.trial080.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506438+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.906 INFO:tasks.workunit.client.0.trial080.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506488+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.906 INFO:tasks.workunit.client.0.trial080.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506388+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.906 INFO:tasks.workunit.client.0.trial080.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506144+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.906 INFO:tasks.workunit.client.0.trial080.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.510006+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.906 INFO:tasks.workunit.client.0.trial080.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507906+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.906 INFO:tasks.workunit.client.0.trial080.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507319+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.906 INFO:tasks.workunit.client.0.trial080.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.508766+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.906 INFO:tasks.workunit.client.0.trial080.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507673+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.907 INFO:tasks.workunit.client.0.trial080.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506301+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.907 INFO:tasks.workunit.client.0.trial080.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506838+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.907 INFO:tasks.workunit.client.0.trial080.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506074+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.907 INFO:tasks.workunit.client.0.trial080.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506125+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.907 INFO:tasks.workunit.client.0.trial080.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:53.990438+0000 31'100 46:143 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:44.598770+0000 0 0 2026-02-18T01:21:21.907 INFO:tasks.workunit.client.0.trial080.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507846+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.907 INFO:tasks.workunit.client.0.trial080.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-18T01:20:43.506421+0000 46'101 46:143 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.907 INFO:tasks.workunit.client.0.trial080.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506787+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.907 INFO:tasks.workunit.client.0.trial080.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506735+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.907 INFO:tasks.workunit.client.0.trial080.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506594+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.907 INFO:tasks.workunit.client.0.trial080.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507791+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.907 INFO:tasks.workunit.client.0.trial080.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506340+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.908 INFO:tasks.workunit.client.0.trial080.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506349+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.908 INFO:tasks.workunit.client.0.trial080.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506358+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.908 INFO:tasks.workunit.client.0.trial080.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506357+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.908 INFO:tasks.workunit.client.0.trial080.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506860+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.908 INFO:tasks.workunit.client.0.trial080.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506883+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.908 INFO:tasks.workunit.client.0.trial080.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507553+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.908 INFO:tasks.workunit.client.0.trial080.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507167+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.908 INFO:tasks.workunit.client.0.trial080.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507597+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:21.908 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:21:21.908 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:21:21.909 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:21:21.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-18T01:21:21.914 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.0 2026-02-18T01:21:21.914 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T01:21:21.914 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T01:21:21.915 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:21:21.915 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:21.915 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:21.915 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.0.asok 2026-02-18T01:21:21.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-18T01:21:21.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.0.asok set_recovery_delay 100000 2026-02-18T01:21:21.969 INFO:tasks.workunit.client.0.trial080.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-18T01:21:21.974 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-18T01:21:21.976 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.2 2026-02-18T01:21:21.976 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-18T01:21:21.976 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-18T01:21:21.976 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:21:21.976 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:21.976 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:21.976 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.2.asok 2026-02-18T01:21:21.977 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-18T01:21:21.977 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.2.asok set_recovery_delay 100000 2026-02-18T01:21:22.028 INFO:tasks.workunit.client.0.trial080.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-18T01:21:22.034 INFO:tasks.workunit.client.0.trial080.stdout:revive divergent 1 2026-02-18T01:21:22.034 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:771: TEST_divergent_3: echo 'revive divergent 1' 2026-02-18T01:21:22.034 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:772: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.508062+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.509720+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506556+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506438+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506488+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506388+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506144+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.510006+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507906+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507319+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.508766+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507673+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506301+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.237 INFO:tasks.workunit.client.0.trial080.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506838+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506074+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506125+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:53.990438+0000 31'100 46:143 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:44.598770+0000 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507846+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-18T01:20:43.506421+0000 46'101 46:143 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506787+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506735+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506594+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507791+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506340+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506349+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506358+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506357+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506860+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506883+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507553+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507167+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507597+0000 31'100 46:142 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:21:22.238 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:21:22.246 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:773: TEST_divergent_3: ceph osd set noup 2026-02-18T01:21:22.553 INFO:tasks.workunit.client.0.trial080.stderr:noup is set 2026-02-18T01:21:22.567 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:774: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-18T01:21:22.567 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:21:22.567 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:21:22.567 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:21:22.568 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:21:22.568 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-18T01:21:22.568 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:21:22.568 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:21:22.568 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:21:22.568 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:21:22.568 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-18T01:21:22.568 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-18T01:21:22.568 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:21:22.568 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:21:22.568 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:21:22.569 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:21:22.569 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:21:22.569 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:21:22.569 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:21:22.569 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:22.569 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:22.569 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:21:22.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:21:22.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:21:22.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:21:22.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:21:22.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:21:22.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:21:22.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:21:22.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:21:22.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:21:22.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:21:22.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-18T01:21:22.571 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:21:22.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:21:22.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:21:22.571 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-18T01:21:22.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:21:22.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:21:22.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:21:22.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:21:22.589 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:22.581+0000 7fd4a3199a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:21:22.590 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:22.585+0000 7fd4a3199a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:21:22.591 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:22.585+0000 7fd4a3199a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:21:22.791 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-18T01:21:22.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:775: TEST_divergent_3: sleep 5 2026-02-18T01:21:22.931 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:22.925+0000 7fd4a3199a40 -1 Falling back to public interface 2026-02-18T01:21:23.557 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:23.549+0000 7fd4a3199a40 -1 osd.1 31 log_to_monitors true 2026-02-18T01:21:27.793 INFO:tasks.workunit.client.0.trial080.stdout:delay recovery divergent 2026-02-18T01:21:27.794 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: echo 'delay recovery divergent' 2026-02-18T01:21:27.794 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:778: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:21:27.992 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:21:27.992 INFO:tasks.workunit.client.0.trial080.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.508062+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.992 INFO:tasks.workunit.client.0.trial080.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.509720+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.993 INFO:tasks.workunit.client.0.trial080.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506556+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.993 INFO:tasks.workunit.client.0.trial080.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506438+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:22:18.625206+0000 0 0 2026-02-18T01:21:27.993 INFO:tasks.workunit.client.0.trial080.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506488+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.993 INFO:tasks.workunit.client.0.trial080.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506388+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:22:08.566093+0000 0 0 2026-02-18T01:21:27.993 INFO:tasks.workunit.client.0.trial080.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506144+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:50.635339+0000 0 0 2026-02-18T01:21:27.993 INFO:tasks.workunit.client.0.trial080.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.510006+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.993 INFO:tasks.workunit.client.0.trial080.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507906+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.993 INFO:tasks.workunit.client.0.trial080.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507319+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.993 INFO:tasks.workunit.client.0.trial080.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.508766+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.993 INFO:tasks.workunit.client.0.trial080.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507673+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.993 INFO:tasks.workunit.client.0.trial080.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506301+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:59.512962+0000 0 0 2026-02-18T01:21:27.994 INFO:tasks.workunit.client.0.trial080.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506838+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:52.662094+0000 0 0 2026-02-18T01:21:27.994 INFO:tasks.workunit.client.0.trial080.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506074+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:49.662561+0000 0 0 2026-02-18T01:21:27.994 INFO:tasks.workunit.client.0.trial080.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506125+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:46.604232+0000 0 0 2026-02-18T01:21:27.994 INFO:tasks.workunit.client.0.trial080.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:53.990438+0000 31'100 48:147 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:44.598770+0000 0 0 2026-02-18T01:21:27.994 INFO:tasks.workunit.client.0.trial080.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507846+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.994 INFO:tasks.workunit.client.0.trial080.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-18T01:20:43.506421+0000 46'101 48:147 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:58.489284+0000 0 0 2026-02-18T01:21:27.994 INFO:tasks.workunit.client.0.trial080.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506787+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.994 INFO:tasks.workunit.client.0.trial080.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506735+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:57.514754+0000 0 0 2026-02-18T01:21:27.994 INFO:tasks.workunit.client.0.trial080.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506594+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:22:04.562947+0000 0 0 2026-02-18T01:21:27.994 INFO:tasks.workunit.client.0.trial080.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507791+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.994 INFO:tasks.workunit.client.0.trial080.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506340+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:22:13.583366+0000 0 0 2026-02-18T01:21:27.994 INFO:tasks.workunit.client.0.trial080.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506349+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:51.660475+0000 0 0 2026-02-18T01:21:27.995 INFO:tasks.workunit.client.0.trial080.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506358+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:22:06.624418+0000 0 0 2026-02-18T01:21:27.995 INFO:tasks.workunit.client.0.trial080.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506357+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:47.621111+0000 0 0 2026-02-18T01:21:27.995 INFO:tasks.workunit.client.0.trial080.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506860+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.995 INFO:tasks.workunit.client.0.trial080.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506883+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:22:19.637213+0000 0 0 2026-02-18T01:21:27.995 INFO:tasks.workunit.client.0.trial080.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507553+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.995 INFO:tasks.workunit.client.0.trial080.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507167+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.995 INFO:tasks.workunit.client.0.trial080.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507597+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:27.995 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:21:27.995 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:21:27.996 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:21:28.001 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: get_asok_path osd.1 2026-02-18T01:21:28.001 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T01:21:28.002 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T01:21:28.002 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:21:28.002 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:28.002 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:28.002 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.1.asok 2026-02-18T01:21:28.002 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: CEPH_ARGS= 2026-02-18T01:21:28.003 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.1.asok set_recovery_delay 100000 2026-02-18T01:21:28.057 INFO:tasks.workunit.client.0.trial080.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-18T01:21:28.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:781: TEST_divergent_3: ceph osd unset noup 2026-02-18T01:21:28.410 INFO:tasks.workunit.client.0.trial080.stderr:noup is unset 2026-02-18T01:21:28.424 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:783: TEST_divergent_3: wait_for_osd up 0 2026-02-18T01:21:28.424 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:21:28.424 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:21:28.424 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:21:28.424 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:21:28.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:21:28.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:21:28.425 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:21:28.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:21:28.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:21:28.643 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 38 up_thru 45 down_at 32 last_clean_interval [5,31) [v2:127.0.0.1:6800/3344064271,v1:127.0.0.1:6801/3344064271] [v2:127.0.0.1:6802/3344064271,v1:127.0.0.1:6803/3344064271] exists,up 3b89a71a-a4f1-42bd-8e61-3912fd1ab000 2026-02-18T01:21:28.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:21:28.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:21:28.645 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:21:28.645 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:784: TEST_divergent_3: wait_for_osd up 1 2026-02-18T01:21:28.645 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:21:28.645 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:21:28.645 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:21:28.645 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:21:28.645 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:21:28.645 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:21:28.646 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:21:28.646 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:21:28.646 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:21:28.850 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 51 up_thru 51 down_at 33 last_clean_interval [10,31) [v2:127.0.0.1:6818/4191383993,v1:127.0.0.1:6819/4191383993] [v2:127.0.0.1:6820/4191383993,v1:127.0.0.1:6821/4191383993] exists,up d10c729f-55e4-4fdd-a451-d20ff188766b 2026-02-18T01:21:28.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:21:28.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:21:28.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:21:28.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:785: TEST_divergent_3: wait_for_osd up 2 2026-02-18T01:21:28.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:21:28.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:21:28.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:21:28.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:21:28.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:21:28.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:21:28.852 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:21:28.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:21:28.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:21:29.066 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 40 up_thru 0 down_at 34 last_clean_interval [15,31) [v2:127.0.0.1:6810/4118971596,v1:127.0.0.1:6811/4118971596] [v2:127.0.0.1:6812/4118971596,v1:127.0.0.1:6813/4118971596] exists,up f291872b-2be6-43af-bb27-4d3ad388962b 2026-02-18T01:21:29.066 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:21:29.066 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:21:29.066 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:21:29.066 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:787: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:21:29.268 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:21:29.268 INFO:tasks.workunit.client.0.trial080.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.508062+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.269 INFO:tasks.workunit.client.0.trial080.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.509720+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.269 INFO:tasks.workunit.client.0.trial080.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506556+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.269 INFO:tasks.workunit.client.0.trial080.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506438+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:22:18.625206+0000 0 0 2026-02-18T01:21:29.269 INFO:tasks.workunit.client.0.trial080.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506488+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.269 INFO:tasks.workunit.client.0.trial080.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506388+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:22:08.566093+0000 0 0 2026-02-18T01:21:29.269 INFO:tasks.workunit.client.0.trial080.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506144+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:50.635339+0000 0 0 2026-02-18T01:21:29.269 INFO:tasks.workunit.client.0.trial080.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.510006+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.269 INFO:tasks.workunit.client.0.trial080.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507906+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.269 INFO:tasks.workunit.client.0.trial080.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507319+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.269 INFO:tasks.workunit.client.0.trial080.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.508766+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.269 INFO:tasks.workunit.client.0.trial080.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507673+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.270 INFO:tasks.workunit.client.0.trial080.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506301+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:59.512962+0000 0 0 2026-02-18T01:21:29.270 INFO:tasks.workunit.client.0.trial080.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506838+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:52.662094+0000 0 0 2026-02-18T01:21:29.270 INFO:tasks.workunit.client.0.trial080.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506074+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:49.662561+0000 0 0 2026-02-18T01:21:29.270 INFO:tasks.workunit.client.0.trial080.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506125+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:46.604232+0000 0 0 2026-02-18T01:21:29.270 INFO:tasks.workunit.client.0.trial080.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:53.990438+0000 31'100 48:147 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:44.598770+0000 0 0 2026-02-18T01:21:29.270 INFO:tasks.workunit.client.0.trial080.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507846+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.270 INFO:tasks.workunit.client.0.trial080.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-18T01:20:43.506421+0000 46'101 48:147 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:58.489284+0000 0 0 2026-02-18T01:21:29.270 INFO:tasks.workunit.client.0.trial080.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506787+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.270 INFO:tasks.workunit.client.0.trial080.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506735+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:57.514754+0000 0 0 2026-02-18T01:21:29.270 INFO:tasks.workunit.client.0.trial080.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506594+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:22:04.562947+0000 0 0 2026-02-18T01:21:29.270 INFO:tasks.workunit.client.0.trial080.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507791+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.271 INFO:tasks.workunit.client.0.trial080.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506340+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:22:13.583366+0000 0 0 2026-02-18T01:21:29.271 INFO:tasks.workunit.client.0.trial080.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506349+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:51.660475+0000 0 0 2026-02-18T01:21:29.271 INFO:tasks.workunit.client.0.trial080.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506358+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:22:06.624418+0000 0 0 2026-02-18T01:21:29.271 INFO:tasks.workunit.client.0.trial080.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506357+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:21:47.621111+0000 0 0 2026-02-18T01:21:29.271 INFO:tasks.workunit.client.0.trial080.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506860+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.271 INFO:tasks.workunit.client.0.trial080.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.506883+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 user requested scrub scheduled @ 2026-02-18T01:22:19.637213+0000 0 0 2026-02-18T01:21:29.271 INFO:tasks.workunit.client.0.trial080.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507553+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.271 INFO:tasks.workunit.client.0.trial080.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507167+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.271 INFO:tasks.workunit.client.0.trial080.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:20:43.507597+0000 31'100 48:146 [0,2] 0 [0,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.271 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:21:29.271 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:21:29.272 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:21:29.277 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:788: TEST_divergent_3: echo 'wait for peering' 2026-02-18T01:21:29.277 INFO:tasks.workunit.client.0.trial080.stdout:wait for peering 2026-02-18T01:21:29.277 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:789: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:21:29.491 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:21:29.492 INFO:tasks.workunit.client.0.trial080.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.538450+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.492 INFO:tasks.workunit.client.0.trial080.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.538731+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.492 INFO:tasks.workunit.client.0.trial080.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.539972+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.492 INFO:tasks.workunit.client.0.trial080.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.534938+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.492 INFO:tasks.workunit.client.0.trial080.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.532387+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.492 INFO:tasks.workunit.client.0.trial080.stdout:1.9 3 1 1 0 0 1600 0 0 11 89 11 active+recovering+degraded 2026-02-18T01:21:28.538357+0000 31'100 52:140 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:21:29.492 INFO:tasks.workunit.client.0.trial080.stdout:1.8 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.536129+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.492 INFO:tasks.workunit.client.0.trial080.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.534994+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.492 INFO:tasks.workunit.client.0.trial080.stdout:1.6 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.535820+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.492 INFO:tasks.workunit.client.0.trial080.stdout:1.5 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.539713+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.493 INFO:tasks.workunit.client.0.trial080.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.532470+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.493 INFO:tasks.workunit.client.0.trial080.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.533586+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.493 INFO:tasks.workunit.client.0.trial080.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.531246+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.493 INFO:tasks.workunit.client.0.trial080.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-18T01:21:28.535930+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.493 INFO:tasks.workunit.client.0.trial080.stdout:1.1 4 0 0 0 0 1600 0 0 15 85 15 active+clean 2026-02-18T01:21:28.535162+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.493 INFO:tasks.workunit.client.0.trial080.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.538617+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.493 INFO:tasks.workunit.client.0.trial080.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-18T01:21:28.540028+0000 31'100 52:149 [1,0,2] 1 [1,0,2] 1 31'100 2026-02-18T01:21:28.539990+0000 0'0 2026-02-18T01:19:50.908039+0000 0 1 periodic scrub scheduled @ 2026-02-19T06:26:52.296655+0000 3 0 2026-02-18T01:21:29.493 INFO:tasks.workunit.client.0.trial080.stdout:1.d 3 0 0 0 0 1600 0 0 12 88 12 active+clean 2026-02-18T01:21:28.534801+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.493 INFO:tasks.workunit.client.0.trial080.stdout:1.e 3 1 1 0 0 2088 0 0 14 87 14 active+recovery_wait+degraded 2026-02-18T01:21:28.537545+0000 46'101 52:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:21:29.493 INFO:tasks.workunit.client.0.trial080.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537243+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.493 INFO:tasks.workunit.client.0.trial080.stdout:1.10 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.538279+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.493 INFO:tasks.workunit.client.0.trial080.stdout:1.11 3 1 1 0 0 1600 0 0 16 84 16 active+recovery_wait+degraded 2026-02-18T01:21:28.537462+0000 31'100 52:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:21:29.494 INFO:tasks.workunit.client.0.trial080.stdout:1.12 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537227+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.494 INFO:tasks.workunit.client.0.trial080.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.537511+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.494 INFO:tasks.workunit.client.0.trial080.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.538386+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.494 INFO:tasks.workunit.client.0.trial080.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.539959+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.494 INFO:tasks.workunit.client.0.trial080.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537321+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.494 INFO:tasks.workunit.client.0.trial080.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537494+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.494 INFO:tasks.workunit.client.0.trial080.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.538320+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.494 INFO:tasks.workunit.client.0.trial080.stdout:1.19 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537473+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.494 INFO:tasks.workunit.client.0.trial080.stdout:1.1a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.535974+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.494 INFO:tasks.workunit.client.0.trial080.stdout:1.1b 3 1 1 0 0 1600 0 0 10 90 10 active+recovery_wait+degraded 2026-02-18T01:21:28.538413+0000 31'100 52:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:21:29.494 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:21:29.494 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:21:29.495 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:21:29.500 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:790: TEST_divergent_3: rados -p test put foo /tmp/tmp.f0qNOgUfmd 2026-02-18T01:21:29.531 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:791: TEST_divergent_3: rm -f /tmp/tmp.f0qNOgUfmd 2026-02-18T01:21:29.532 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: rm -f /tmp/tmp.bkuxPuJzPP 2026-02-18T01:21:29.533 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:796: TEST_divergent_3: echo 'killing divergent 1' 2026-02-18T01:21:29.533 INFO:tasks.workunit.client.0.trial080.stdout:killing divergent 1 2026-02-18T01:21:29.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:21:29.735 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:21:29.736 INFO:tasks.workunit.client.0.trial080.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.538450+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.736 INFO:tasks.workunit.client.0.trial080.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.538731+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.736 INFO:tasks.workunit.client.0.trial080.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.539972+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.736 INFO:tasks.workunit.client.0.trial080.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.534938+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.736 INFO:tasks.workunit.client.0.trial080.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.532387+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.736 INFO:tasks.workunit.client.0.trial080.stdout:1.9 3 1 1 0 0 1600 0 0 11 89 11 active+recovering+degraded 2026-02-18T01:21:28.538357+0000 31'100 52:140 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:21:29.736 INFO:tasks.workunit.client.0.trial080.stdout:1.8 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.536129+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.736 INFO:tasks.workunit.client.0.trial080.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.534994+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.737 INFO:tasks.workunit.client.0.trial080.stdout:1.6 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.535820+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.737 INFO:tasks.workunit.client.0.trial080.stdout:1.5 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.539713+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.737 INFO:tasks.workunit.client.0.trial080.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.532470+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.737 INFO:tasks.workunit.client.0.trial080.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.533586+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.737 INFO:tasks.workunit.client.0.trial080.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.531246+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.737 INFO:tasks.workunit.client.0.trial080.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-18T01:21:28.535930+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.737 INFO:tasks.workunit.client.0.trial080.stdout:1.1 4 0 0 0 0 1600 0 0 15 85 15 active+clean 2026-02-18T01:21:28.535162+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.737 INFO:tasks.workunit.client.0.trial080.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.538617+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.737 INFO:tasks.workunit.client.0.trial080.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-18T01:21:28.540028+0000 31'100 52:149 [1,0,2] 1 [1,0,2] 1 31'100 2026-02-18T01:21:28.539990+0000 0'0 2026-02-18T01:19:50.908039+0000 0 1 periodic scrub scheduled @ 2026-02-19T06:26:52.296655+0000 3 0 2026-02-18T01:21:29.738 INFO:tasks.workunit.client.0.trial080.stdout:1.d 3 0 0 0 0 1600 0 0 12 88 12 active+clean 2026-02-18T01:21:28.534801+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.738 INFO:tasks.workunit.client.0.trial080.stdout:1.e 3 1 1 0 0 2088 0 0 14 87 14 active+recovery_wait+degraded 2026-02-18T01:21:28.537545+0000 46'101 52:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:21:29.738 INFO:tasks.workunit.client.0.trial080.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537243+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.738 INFO:tasks.workunit.client.0.trial080.stdout:1.10 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.538279+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.738 INFO:tasks.workunit.client.0.trial080.stdout:1.11 3 1 1 0 0 1600 0 0 16 84 16 active+recovery_wait+degraded 2026-02-18T01:21:28.537462+0000 31'100 52:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:21:29.738 INFO:tasks.workunit.client.0.trial080.stdout:1.12 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537227+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.738 INFO:tasks.workunit.client.0.trial080.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.537511+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.738 INFO:tasks.workunit.client.0.trial080.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.538386+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.738 INFO:tasks.workunit.client.0.trial080.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.539959+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.738 INFO:tasks.workunit.client.0.trial080.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537321+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.738 INFO:tasks.workunit.client.0.trial080.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537494+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.739 INFO:tasks.workunit.client.0.trial080.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.538320+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.739 INFO:tasks.workunit.client.0.trial080.stdout:1.19 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537473+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.739 INFO:tasks.workunit.client.0.trial080.stdout:1.1a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.535974+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:29.739 INFO:tasks.workunit.client.0.trial080.stdout:1.1b 3 1 1 0 0 1600 0 0 10 90 10 active+recovery_wait+degraded 2026-02-18T01:21:28.538413+0000 31'100 52:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:21:29.739 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:21:29.739 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:21:29.739 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:21:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:798: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd.1 2026-02-18T01:21:29.745 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:21:29.745 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:21:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:21:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:21:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:21:29.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:21:29.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:801: TEST_divergent_3: expfile=td/divergent-priors/exp.16037.out 2026-02-18T01:21:29.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:802: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16037.out 2026-02-18T01:21:29.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-18T01:21:29.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T01:21:29.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T01:21:29.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T01:21:29.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-18T01:21:29.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16037.out 2026-02-18T01:21:30.086 INFO:tasks.workunit.client.0.trial080.stderr:Exporting 1.0 info 1.0( v 31'100 (31'90,31'100] local-lis/les=51/52 n=3 ec=23/23 lis/c=51/51 les/c/f=52/52/0 sis=51) 2026-02-18T01:21:30.087 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-18T01:21:30.087 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-18T01:21:30.087 INFO:tasks.workunit.client.0.trial080.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-18T01:21:30.087 INFO:tasks.workunit.client.0.trial080.stderr:Export successful 2026-02-18T01:21:30.088 INFO:tasks.workunit.client.0.trial080.stdout: marking collection for removal 2026-02-18T01:21:30.088 INFO:tasks.workunit.client.0.trial080.stdout:setting '_remove' omap key 2026-02-18T01:21:30.088 INFO:tasks.workunit.client.0.trial080.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-18T01:21:30.088 INFO:tasks.workunit.client.0.trial080.stderr:Remove successful 2026-02-18T01:21:30.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:803: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.16037.out 2026-02-18T01:21:30.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-18T01:21:30.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T01:21:30.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T01:21:30.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T01:21:30.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-18T01:21:30.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.16037.out 2026-02-18T01:21:30.385 INFO:tasks.workunit.client.0.trial080.stdout:get_pg_num_history pg_num_history pg_num_history(e52 pg_nums {1={23=1,45=32}} deleted_pools ) 2026-02-18T01:21:30.385 INFO:tasks.workunit.client.0.trial080.stdout:Importing pgid 1.0 2026-02-18T01:21:30.385 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-18T01:21:30.386 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:21:30.386 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-18T01:21:30.386 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:21:30.386 INFO:tasks.workunit.client.0.trial080.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-18T01:21:30.386 INFO:tasks.workunit.client.0.trial080.stdout:snapset 0={} 2026-02-18T01:21:30.386 INFO:tasks.workunit.client.0.trial080.stdout:write_pg epoch 52 info 1.0( v 31'100 (31'90,31'100] local-lis/les=51/52 n=3 ec=23/23 lis/c=51/51 les/c/f=52/52/0 sis=51) 2026-02-18T01:21:30.386 INFO:tasks.workunit.client.0.trial080.stdout:Import successful 2026-02-18T01:21:30.477 INFO:tasks.workunit.client.0.trial080.stdout:reviving divergent 1 2026-02-18T01:21:30.478 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:805: TEST_divergent_3: echo 'reviving divergent 1' 2026-02-18T01:21:30.478 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.538450+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.538731+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.539972+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.534938+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.532387+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.9 3 1 1 0 0 1600 0 0 11 89 11 active+recovering+degraded 2026-02-18T01:21:28.538357+0000 31'100 52:140 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.8 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.536129+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.534994+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.6 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.535820+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.5 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.539713+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.532470+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.533586+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.531246+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-18T01:21:28.535930+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.681 INFO:tasks.workunit.client.0.trial080.stdout:1.1 4 0 0 0 0 1600 0 0 15 85 15 active+clean 2026-02-18T01:21:28.535162+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.538617+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-18T01:21:28.540028+0000 31'100 52:149 [1,0,2] 1 [1,0,2] 1 31'100 2026-02-18T01:21:28.539990+0000 0'0 2026-02-18T01:19:50.908039+0000 0 1 periodic scrub scheduled @ 2026-02-19T06:26:52.296655+0000 3 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.d 3 0 0 0 0 1600 0 0 12 88 12 active+clean 2026-02-18T01:21:28.534801+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.e 3 1 1 0 0 2088 0 0 14 87 14 active+recovery_wait+degraded 2026-02-18T01:21:28.537545+0000 46'101 52:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537243+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.10 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.538279+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.11 3 1 1 0 0 1600 0 0 16 84 16 active+recovery_wait+degraded 2026-02-18T01:21:28.537462+0000 31'100 52:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.12 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537227+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.537511+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.538386+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.539959+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537321+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537494+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:28.538320+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.19 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.537473+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.1a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:28.535974+0000 31'100 52:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:1.1b 3 1 1 0 0 1600 0 0 10 90 10 active+recovery_wait+degraded 2026-02-18T01:21:28.538413+0000 31'100 52:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:21:30.682 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:21:30.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-18T01:21:30.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:21:30.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:21:30.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:21:30.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:21:30.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-18T01:21:30.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:21:30.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:21:30.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:21:30.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:21:30.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-18T01:21:30.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-18T01:21:30.691 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:21:30.691 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:21:30.691 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:21:30.691 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:21:30.691 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:21:30.691 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:21:30.691 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:21:30.691 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:30.691 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:30.691 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:21:30.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:21:30.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:21:30.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:21:30.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:21:30.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:21:30.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:21:30.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:21:30.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:21:30.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:21:30.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:21:30.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-18T01:21:30.693 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:21:30.693 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:21:30.693 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:21:30.693 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-18T01:21:30.694 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:21:30.695 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:21:30.695 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:21:30.695 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:21:30.710 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:30.705+0000 7f88e05c5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:21:30.712 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:30.705+0000 7f88e05c5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:21:30.713 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:30.705+0000 7f88e05c5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:21:30.909 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T01:21:30.909 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:21:30.909 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:21:30.909 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:21:30.909 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:21:30.909 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:21:30.909 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:21:30.910 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:21:30.910 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:21:30.910 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:21:31.106 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:31.101+0000 7f88e05c5a40 -1 Falling back to public interface 2026-02-18T01:21:31.127 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 51 up_thru 51 down_at 33 last_clean_interval [10,31) [v2:127.0.0.1:6818/4191383993,v1:127.0.0.1:6819/4191383993] [v2:127.0.0.1:6820/4191383993,v1:127.0.0.1:6821/4191383993] exists,up d10c729f-55e4-4fdd-a451-d20ff188766b 2026-02-18T01:21:31.128 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:21:31.128 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:21:31.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:21:31.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: wait_for_osd up 1 2026-02-18T01:21:31.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:21:31.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:21:31.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:21:31.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:21:31.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:21:31.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:21:31.129 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:21:31.130 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:21:31.130 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:21:31.338 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 51 up_thru 51 down_at 33 last_clean_interval [10,31) [v2:127.0.0.1:6818/4191383993,v1:127.0.0.1:6819/4191383993] [v2:127.0.0.1:6820/4191383993,v1:127.0.0.1:6821/4191383993] exists,up d10c729f-55e4-4fdd-a451-d20ff188766b 2026-02-18T01:21:31.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:21:31.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:21:31.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:21:31.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: sleep 20 2026-02-18T01:21:31.867 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:31.861+0000 7f88e05c5a40 -1 osd.1 52 log_to_monitors true 2026-02-18T01:21:51.340 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: get_asok_path osd.1 2026-02-18T01:21:51.341 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T01:21:51.341 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T01:21:51.342 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:21:51.342 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:51.342 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:51.342 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.1.asok 2026-02-18T01:21:51.342 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: CEPH_ARGS= 2026-02-18T01:21:51.342 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.1.asok dump_ops_in_flight 2026-02-18T01:21:51.396 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:21:51.397 INFO:tasks.workunit.client.0.trial080.stdout: "ops": [], 2026-02-18T01:21:51.397 INFO:tasks.workunit.client.0.trial080.stdout: "num_ops": 0 2026-02-18T01:21:51.397 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:21:51.402 INFO:tasks.workunit.client.0.trial080.stdout:allowing recovery 2026-02-18T01:21:51.403 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:813: TEST_divergent_3: echo 'allowing recovery' 2026-02-18T01:21:51.403 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:21:51.616 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:21:51.616 INFO:tasks.workunit.client.0.trial080.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:41.529053+0000 31'100 64:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.616 INFO:tasks.workunit.client.0.trial080.stdout:1.1e 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:39.529296+0000 31'100 62:167 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.616 INFO:tasks.workunit.client.0.trial080.stdout:1.1d 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-18T01:21:47.629648+0000 31'100 67:165 [2,0,1] 2 [2,0,1] 2 31'100 2026-02-18T01:21:47.629585+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T09:58:56.280248+0000 4 0 2026-02-18T01:21:51.617 INFO:tasks.workunit.client.0.trial080.stdout:1.b 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-18T01:21:45.966723+0000 31'100 64:187 [1,2,0] 1 [1,2,0] 1 31'100 2026-02-18T01:21:45.966664+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T05:35:31.037057+0000 3 0 2026-02-18T01:21:51.617 INFO:tasks.workunit.client.0.trial080.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:39.529474+0000 31'100 66:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.617 INFO:tasks.workunit.client.0.trial080.stdout:1.9 5 0 0 0 0 2560 0 0 16 84 16 active+clean 2026-02-18T01:21:42.624785+0000 31'100 67:165 [2,0,1] 2 [2,0,1] 2 31'100 2026-02-18T01:21:42.624747+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T03:26:59.142238+0000 5 0 2026-02-18T01:21:51.617 INFO:tasks.workunit.client.0.trial080.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-18T01:21:41.869731+0000 31'100 64:182 [1,0,2] 1 [1,0,2] 1 31'100 2026-02-18T01:21:41.869692+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T10:54:22.430569+0000 3 0 2026-02-18T01:21:51.617 INFO:tasks.workunit.client.0.trial080.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:41.528813+0000 31'100 64:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.617 INFO:tasks.workunit.client.0.trial080.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-18T01:21:39.529530+0000 52'101 62:159 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.617 INFO:tasks.workunit.client.0.trial080.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:37.530100+0000 31'100 67:157 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.617 INFO:tasks.workunit.client.0.trial080.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:32.255571+0000 31'100 64:173 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.617 INFO:tasks.workunit.client.0.trial080.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:41.528617+0000 31'100 64:171 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.617 INFO:tasks.workunit.client.0.trial080.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:39.528987+0000 31'100 66:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.617 INFO:tasks.workunit.client.0.trial080.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-18T01:21:32.252906+0000 31'100 64:174 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.617 INFO:tasks.workunit.client.0.trial080.stdout:1.1 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-18T01:21:45.553934+0000 31'100 67:165 [2,0,1] 2 [2,0,1] 2 31'100 2026-02-18T01:21:45.553891+0000 0'0 2026-02-18T01:19:50.908039+0000 0 1 periodic scrub scheduled @ 2026-02-19T08:37:08.859765+0000 2 0 2026-02-18T01:21:51.618 INFO:tasks.workunit.client.0.trial080.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:32.255117+0000 31'100 64:173 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.618 INFO:tasks.workunit.client.0.trial080.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-18T01:21:37.872043+0000 31'100 64:189 [1,0,2] 1 [1,0,2] 1 31'100 2026-02-18T01:21:37.871980+0000 0'0 2026-02-18T01:19:50.908039+0000 0 1 periodic scrub scheduled @ 2026-02-19T06:59:25.716712+0000 3 0 2026-02-18T01:21:51.618 INFO:tasks.workunit.client.0.trial080.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:37.530068+0000 31'100 67:157 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.618 INFO:tasks.workunit.client.0.trial080.stdout:1.e 3 0 0 0 0 2088 0 0 17 84 17 active+clean 2026-02-18T01:21:39.529312+0000 46'101 62:168 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.618 INFO:tasks.workunit.client.0.trial080.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:41.528714+0000 31'100 64:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.618 INFO:tasks.workunit.client.0.trial080.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-18T01:21:44.918011+0000 31'100 64:182 [1,0,2] 1 [1,0,2] 1 31'100 2026-02-18T01:21:44.917957+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:17:28.008630+0000 3 0 2026-02-18T01:21:51.618 INFO:tasks.workunit.client.0.trial080.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-18T01:21:38.662645+0000 31'100 67:165 [2,0,1] 2 [2,0,1] 2 31'100 2026-02-18T01:21:38.662601+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T05:22:04.443806+0000 3 0 2026-02-18T01:21:51.618 INFO:tasks.workunit.client.0.trial080.stdout:1.12 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:39.529169+0000 31'100 66:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.618 INFO:tasks.workunit.client.0.trial080.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:41.529050+0000 31'100 64:171 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.618 INFO:tasks.workunit.client.0.trial080.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:32.256008+0000 31'100 64:174 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.618 INFO:tasks.workunit.client.0.trial080.stdout:1.15 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-18T01:21:49.663734+0000 31'100 67:165 [2,0,1] 2 [2,0,1] 2 31'100 2026-02-18T01:21:49.663682+0000 0'0 2026-02-18T01:19:50.908039+0000 0 1 periodic scrub scheduled @ 2026-02-19T09:49:40.878443+0000 3 0 2026-02-18T01:21:51.618 INFO:tasks.workunit.client.0.trial080.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:39.529005+0000 31'100 62:167 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.619 INFO:tasks.workunit.client.0.trial080.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:41.529025+0000 31'100 64:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.619 INFO:tasks.workunit.client.0.trial080.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:32.254171+0000 31'100 64:174 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.619 INFO:tasks.workunit.client.0.trial080.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-18T01:21:41.646048+0000 31'100 67:165 [2,0,1] 2 [2,0,1] 2 31'100 2026-02-18T01:21:41.645993+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:43:02.492557+0000 2 0 2026-02-18T01:21:51.619 INFO:tasks.workunit.client.0.trial080.stdout:1.1a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:39.529283+0000 31'100 66:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.619 INFO:tasks.workunit.client.0.trial080.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:41.528770+0000 31'100 64:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:51.619 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:21:51.619 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:21:51.619 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:21:51.625 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-18T01:21:51.625 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-18T01:21:51.697 INFO:tasks.workunit.client.0.trial080.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-18T01:21:51.704 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-18T01:21:51.704 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-18T01:21:51.787 INFO:tasks.workunit.client.0.trial080.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-18T01:21:51.795 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-18T01:21:51.795 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-18T01:21:51.874 INFO:tasks.workunit.client.0.trial080.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-18T01:21:51.884 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: echo 'reading divergent objects' 2026-02-18T01:21:51.885 INFO:tasks.workunit.client.0.trial080.stdout:reading divergent objects 2026-02-18T01:21:51.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:822: TEST_divergent_3: ceph pg dump pgs 2026-02-18T01:21:52.088 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:21:52.088 INFO:tasks.workunit.client.0.trial080.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:41.529053+0000 31'100 64:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.088 INFO:tasks.workunit.client.0.trial080.stdout:1.1e 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:39.529296+0000 31'100 62:167 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.088 INFO:tasks.workunit.client.0.trial080.stdout:1.1d 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-18T01:21:47.629648+0000 31'100 67:165 [2,0,1] 2 [2,0,1] 2 31'100 2026-02-18T01:21:47.629585+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T09:58:56.280248+0000 4 0 2026-02-18T01:21:52.088 INFO:tasks.workunit.client.0.trial080.stdout:1.b 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-18T01:21:45.966723+0000 31'100 64:187 [1,2,0] 1 [1,2,0] 1 31'100 2026-02-18T01:21:45.966664+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T05:35:31.037057+0000 3 0 2026-02-18T01:21:52.088 INFO:tasks.workunit.client.0.trial080.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:39.529474+0000 31'100 66:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.088 INFO:tasks.workunit.client.0.trial080.stdout:1.9 5 0 0 0 0 2560 0 0 16 84 16 active+clean 2026-02-18T01:21:42.624785+0000 31'100 67:165 [2,0,1] 2 [2,0,1] 2 31'100 2026-02-18T01:21:42.624747+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T03:26:59.142238+0000 5 0 2026-02-18T01:21:52.088 INFO:tasks.workunit.client.0.trial080.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-18T01:21:41.869731+0000 31'100 64:182 [1,0,2] 1 [1,0,2] 1 31'100 2026-02-18T01:21:41.869692+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T10:54:22.430569+0000 3 0 2026-02-18T01:21:52.088 INFO:tasks.workunit.client.0.trial080.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:41.528813+0000 31'100 64:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.089 INFO:tasks.workunit.client.0.trial080.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-18T01:21:39.529530+0000 52'101 62:159 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.089 INFO:tasks.workunit.client.0.trial080.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:37.530100+0000 31'100 67:157 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.089 INFO:tasks.workunit.client.0.trial080.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:32.255571+0000 31'100 64:173 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.089 INFO:tasks.workunit.client.0.trial080.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:41.528617+0000 31'100 64:171 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.089 INFO:tasks.workunit.client.0.trial080.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:39.528987+0000 31'100 66:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.089 INFO:tasks.workunit.client.0.trial080.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-18T01:21:32.252906+0000 31'100 64:174 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.089 INFO:tasks.workunit.client.0.trial080.stdout:1.1 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-18T01:21:45.553934+0000 31'100 67:165 [2,0,1] 2 [2,0,1] 2 31'100 2026-02-18T01:21:45.553891+0000 0'0 2026-02-18T01:19:50.908039+0000 0 1 periodic scrub scheduled @ 2026-02-19T08:37:08.859765+0000 2 0 2026-02-18T01:21:52.089 INFO:tasks.workunit.client.0.trial080.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:32.255117+0000 31'100 64:173 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.089 INFO:tasks.workunit.client.0.trial080.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-18T01:21:37.872043+0000 31'100 64:189 [1,0,2] 1 [1,0,2] 1 31'100 2026-02-18T01:21:37.871980+0000 0'0 2026-02-18T01:19:50.908039+0000 0 1 periodic scrub scheduled @ 2026-02-19T06:59:25.716712+0000 3 0 2026-02-18T01:21:52.089 INFO:tasks.workunit.client.0.trial080.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:37.530068+0000 31'100 67:157 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.089 INFO:tasks.workunit.client.0.trial080.stdout:1.e 3 0 0 0 0 2088 0 0 17 84 17 active+clean 2026-02-18T01:21:39.529312+0000 46'101 62:168 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:41.528714+0000 31'100 64:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-18T01:21:44.918011+0000 31'100 64:182 [1,0,2] 1 [1,0,2] 1 31'100 2026-02-18T01:21:44.917957+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:17:28.008630+0000 3 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-18T01:21:38.662645+0000 31'100 67:165 [2,0,1] 2 [2,0,1] 2 31'100 2026-02-18T01:21:38.662601+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T05:22:04.443806+0000 3 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.12 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:39.529169+0000 31'100 66:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:41.529050+0000 31'100 64:171 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:32.256008+0000 31'100 64:174 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.15 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-18T01:21:49.663734+0000 31'100 67:165 [2,0,1] 2 [2,0,1] 2 31'100 2026-02-18T01:21:49.663682+0000 0'0 2026-02-18T01:19:50.908039+0000 0 1 periodic scrub scheduled @ 2026-02-19T09:49:40.878443+0000 3 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:39.529005+0000 31'100 62:167 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:41.529025+0000 31'100 64:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:32.254171+0000 31'100 64:174 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-18T01:21:41.646048+0000 31'100 67:165 [2,0,1] 2 [2,0,1] 2 31'100 2026-02-18T01:21:41.645993+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:43:02.492557+0000 2 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.1a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-18T01:21:39.529283+0000 31'100 66:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.090 INFO:tasks.workunit.client.0.trial080.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-18T01:21:41.528770+0000 31'100 64:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-18T01:19:50.908039+0000 0'0 2026-02-18T01:19:50.908039+0000 0 0 queued for scrub 0 0 2026-02-18T01:21:52.091 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:21:52.091 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:21:52.091 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:21:52.097 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: expr 2 + 2 2026-02-18T01:21:52.098 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: seq 1 4 2026-02-18T01:21:52.099 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:21:52.099 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_1 td/divergent-priors/existing 2026-02-18T01:21:52.121 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:21:52.121 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_2 td/divergent-priors/existing 2026-02-18T01:21:52.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:21:52.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_3 td/divergent-priors/existing 2026-02-18T01:21:52.176 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:21:52.176 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_4 td/divergent-priors/existing 2026-02-18T01:21:52.206 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: seq 1 2 2026-02-18T01:21:52.207 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-18T01:21:52.207 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-18T01:21:52.227 INFO:tasks.workunit.client.0.trial080.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-18T01:21:52.228 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-18T01:21:52.229 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-18T01:21:52.255 INFO:tasks.workunit.client.0.trial080.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-18T01:21:52.257 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: rm -f td/divergent-priors/existing 2026-02-18T01:21:52.258 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-18T01:21:52.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-18T01:21:52.263 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd480115640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 31'102 (31'2) modify 1:97db2a0f:::existing_2:head by client.4542.0:1 2026-02-18T01:20:05.308187+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:21:52.263 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd480115640 20 _merge_object_divergent_entries: keeping 31'102 (31'2) modify 1:97db2a0f:::existing_2:head by client.4542.0:1 2026-02-18T01:20:05.308187+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:21:52.264 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd480115640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:21:52.264 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 31'2 first_divergent_update: 31'102 last_divergent_update: 31'102 2026-02-18T01:21:52.264 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-18T01:21:52.264 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-18T01:21:52.264 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 31'106 2026-02-18T01:21:52.264 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 31'102 (31'2) modify 1:97db2a0f:::existing_2:head by client.4542.0:1 2026-02-18T01:20:05.308187+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:21:52.264 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-18T01:21:52.264 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 31'2 <= info.log_tail 31'89 2026-02-18T01:21:52.264 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 31'104 (31'1) modify 1:d858c035:::existing_1:head by client.4543.0:1 2026-02-18T01:20:05.308715+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:21:52.264 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 20 _merge_object_divergent_entries: keeping 31'104 (31'1) modify 1:d858c035:::existing_1:head by client.4543.0:1 2026-02-18T01:20:05.308715+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:21:52.264 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:21:52.265 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 31'1 first_divergent_update: 31'104 last_divergent_update: 31'104 2026-02-18T01:21:52.265 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-18T01:21:52.265 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-18T01:21:52.265 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 31'106 2026-02-18T01:21:52.265 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 31'104 (31'1) modify 1:d858c035:::existing_1:head by client.4543.0:1 2026-02-18T01:20:05.308715+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:21:52.265 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-18T01:21:52.265 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 31'1 <= info.log_tail 31'90 2026-02-18T01:21:52.265 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 31'103 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4541.0:1 2026-02-18T01:20:05.308522+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-18T01:21:52.265 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 20 _merge_object_divergent_entries: keeping 31'103 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4541.0:1 2026-02-18T01:20:05.308522+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-18T01:21:52.265 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:21:52.265 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 31'103 last_divergent_update: 31'103 2026-02-18T01:21:52.265 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-18T01:21:52.266 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.525+0000 7fd47f113640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-18T01:21:52.266 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd480115640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 31'105 (31'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-18T01:20:05.312720+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-18T01:21:52.266 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd480115640 20 _merge_object_divergent_entries: keeping 31'105 (31'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-18T01:20:05.312720+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-18T01:21:52.266 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd480115640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-18T01:21:52.266 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 31'3 first_divergent_update: 31'105 last_divergent_update: 31'105 2026-02-18T01:21:52.266 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-18T01:21:52.266 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-18T01:21:52.266 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 31'106 2026-02-18T01:21:52.266 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 31'105 (31'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-18T01:20:05.312720+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-18T01:21:52.271 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-18T01:21:52.272 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd480115640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 31'3 <= info.log_tail 31'84 2026-02-18T01:21:52.272 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd47d910640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 31'106 (31'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-18T01:20:05.315269+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-18T01:21:52.272 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd47d910640 20 _merge_object_divergent_entries: keeping 31'106 (31'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-18T01:20:05.315269+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-18T01:21:52.272 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd47d910640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:21:52.272 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd47d910640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 31'4 first_divergent_update: 31'106 last_divergent_update: 31'106 2026-02-18T01:21:52.272 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd47d910640 10 _merge_object_divergent_entries: more recent entry found: 46'101 (31'4) modify 1:70b3bf12:::existing_4:head by client.4660.0:1 2026-02-18T01:20:52.134494+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-18T01:21:52.272 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd47d910640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 31'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4540.0:1 2026-02-18T01:20:05.307727+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-18T01:21:52.272 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd47d910640 20 _merge_object_divergent_entries: keeping 31'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4540.0:1 2026-02-18T01:20:05.307727+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-18T01:21:52.272 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd47d910640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:21:52.272 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd47d910640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 31'101 last_divergent_update: 31'101 2026-02-18T01:21:52.272 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd47d910640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-18T01:21:52.273 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:21:28.529+0000 7fd47d910640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-18T01:21:52.273 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-18T01:21:52.273 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-18T01:21:52.277 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-18T01:21:52.278 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-18T01:21:52.282 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:846: TEST_divergent_3: echo success 2026-02-18T01:21:52.282 INFO:tasks.workunit.client.0.trial080.stdout:success 2026-02-18T01:21:52.283 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:848: TEST_divergent_3: rm td/divergent-priors/td/divergent-priors/exp.16037.out 2026-02-18T01:21:52.283 INFO:tasks.workunit.client.0.trial080.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.16037.out': No such file or directory 2026-02-18T01:21:52.284 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:849: TEST_divergent_3: delete_pool test 2026-02-18T01:21:52.284 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-18T01:21:52.284 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-18T01:21:52.540 INFO:tasks.workunit.client.0.trial080.stderr:pool 'test' does not exist 2026-02-18T01:21:52.550 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:850: TEST_divergent_3: kill_daemons td/divergent-priors 2026-02-18T01:21:52.551 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:21:52.551 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:21:52.551 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:21:52.551 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:21:52.551 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:21:57.867 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:21:57.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-18T01:21:57.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-18T01:21:57.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:21:57.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-18T01:21:57.868 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:21:57.869 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:21:57.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:21:57.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:21:57.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:21:57.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:21:57.876 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:21:57.876 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:21:57.877 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:21:57.878 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:21:57.878 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:21:57.878 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:21:57.879 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:21:57.879 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:21:57.880 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:21:57.880 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:21:57.881 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:21:57.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:21:57.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-18T01:21:57.910 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:21:57.910 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:57.910 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:57.910 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16037 2026-02-18T01:21:57.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:21:57.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:21:57.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-18T01:21:57.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-18T01:21:57.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-18T01:21:57.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-18T01:21:57.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-18T01:21:57.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:21:57.913 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-18T01:21:57.914 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:21:57.914 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:21:57.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:21:57.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:21:57.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:21:57.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:21:57.915 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:21:57.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:21:57.916 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:21:57.917 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:21:57.917 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:21:57.917 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:21:57.918 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:21:57.918 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:21:57.919 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:21:57.919 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:21:57.920 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:21:57.921 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:21:57.921 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-18T01:21:57.923 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:21:57.923 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:57.923 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:57.923 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16037 2026-02-18T01:21:57.924 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:21:57.924 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:21:57.924 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-18T01:21:57.926 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:21:57.926 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:57.926 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:57.926 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16037 2026-02-18T01:21:57.927 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:21:57.928 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T01:21:57.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:21:57.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-18T01:21:57.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_ec td/divergent-priors 2026-02-18T01:21:57.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:227: TEST_divergent_ec: local dir=td/divergent-priors 2026-02-18T01:21:57.929 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: file_with_random_data 2026-02-18T01:21:57.929 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=512 2026-02-18T01:21:57.930 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-18T01:21:57.930 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.U1sUw4n52M 2026-02-18T01:21:57.930 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.U1sUw4n52M bs=512 count=1 2026-02-18T01:21:57.931 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records in 2026-02-18T01:21:57.931 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records out 2026-02-18T01:21:57.931 INFO:tasks.workunit.client.0.trial080.stderr:512 bytes copied, 5.0454e-05 s, 10.1 MB/s 2026-02-18T01:21:57.931 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.U1sUw4n52M 2026-02-18T01:21:57.932 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: local dummyfile=/tmp/tmp.U1sUw4n52M 2026-02-18T01:21:57.932 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: file_with_random_data 1000 2026-02-18T01:21:57.932 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=1000 2026-02-18T01:21:57.932 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-18T01:21:57.933 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.TjYHSp1N4J 2026-02-18T01:21:57.933 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.TjYHSp1N4J bs=1000 count=1 2026-02-18T01:21:57.934 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records in 2026-02-18T01:21:57.934 INFO:tasks.workunit.client.0.trial080.stderr:1+0 records out 2026-02-18T01:21:57.934 INFO:tasks.workunit.client.0.trial080.stderr:1000 bytes (1.0 kB) copied, 7.8215e-05 s, 12.8 MB/s 2026-02-18T01:21:57.935 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.TjYHSp1N4J 2026-02-18T01:21:57.935 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: local dummyfile2=/tmp/tmp.TjYHSp1N4J 2026-02-18T01:21:57.935 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:233: TEST_divergent_ec: local num_osds=3 2026-02-18T01:21:57.936 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: expr 3 - 1 2026-02-18T01:21:57.937 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: seq 0 2 2026-02-18T01:21:57.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: local 'osds=0 2026-02-18T01:21:57.938 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:21:57.938 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:21:57.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: run_mon td/divergent-priors a 2026-02-18T01:21:57.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-18T01:21:57.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:21:57.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:21:57.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:21:57.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-18T01:21:57.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-18T01:21:57.962 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:21:57.962 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:21:57.962 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:21:57.963 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:21:57.963 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:57.963 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:57.963 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:21:57.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T01:21:57.995 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:21:57.996 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:21:57.996 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:21:57.996 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:21:57.997 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:21:57.997 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:21:57.998 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:21:57.998 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:21:57.998 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:21:57.998 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:21:57.999 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:57.999 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:57.999 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-mon.a.asok 2026-02-18T01:21:57.999 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:21:57.999 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16037/ceph-mon.a.asok config get fsid 2026-02-18T01:21:58.055 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:21:58.055 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:21:58.055 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:21:58.055 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:21:58.055 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:21:58.057 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:21:58.057 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:21:58.057 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:21:58.057 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:21:58.057 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:58.058 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:58.058 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-mon.a.asok 2026-02-18T01:21:58.058 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:21:58.058 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16037/ceph-mon.a.asok config get mon_host 2026-02-18T01:21:58.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:236: TEST_divergent_ec: run_mgr td/divergent-priors x 2026-02-18T01:21:58.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-18T01:21:58.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:21:58.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T01:21:58.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:21:58.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-18T01:21:58.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:21:58.227 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:21:58.227 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:21:58.228 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:21:58.228 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:21:58.228 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:58.228 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:58.228 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:21:58.229 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:21:58.229 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:21:58.252 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-18T01:21:58.252 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 0 2026-02-18T01:21:58.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-18T01:21:58.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:21:58.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:21:58.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:21:58.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-18T01:21:58.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:21:58.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:21:58.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:21:58.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:21:58.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-18T01:21:58.254 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-18T01:21:58.254 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:21:58.254 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:21:58.254 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:21:58.254 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:21:58.254 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:21:58.254 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:21:58.254 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:21:58.254 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:21:58.254 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:21:58.254 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:21:58.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:21:58.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:21:58.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:21:58.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:21:58.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:21:58.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:21:58.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:21:58.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:21:58.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:21:58.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:21:58.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:21:58.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:21:58.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-18T01:21:58.256 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:21:58.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=93913594-6b7e-4e41-b650-1ee84f36d147 2026-02-18T01:21:58.257 INFO:tasks.workunit.client.0.trial080.stdout:add osd0 93913594-6b7e-4e41-b650-1ee84f36d147 2026-02-18T01:21:58.257 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 93913594-6b7e-4e41-b650-1ee84f36d147' 2026-02-18T01:21:58.257 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:21:58.266 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA2FJVp1W2gDxAAP4fJh9v3WelWdJ0nJRhG8g== 2026-02-18T01:21:58.266 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA2FJVp1W2gDxAAP4fJh9v3WelWdJ0nJRhG8g=="}' 2026-02-18T01:21:58.266 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 93913594-6b7e-4e41-b650-1ee84f36d147 -i td/divergent-priors/0/new.json 2026-02-18T01:21:58.378 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:21:58.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-18T01:21:58.388 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA2FJVp1W2gDxAAP4fJh9v3WelWdJ0nJRhG8g== --osd-uuid 93913594-6b7e-4e41-b650-1ee84f36d147 2026-02-18T01:21:58.406 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:58.401+0000 7fa5f1e36a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:21:58.408 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:58.401+0000 7fa5f1e36a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:21:58.409 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:58.401+0000 7fa5f1e36a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:21:58.409 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:58.405+0000 7fa5f1e36a40 -1 bdev(0x55b28db4ec00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:21:58.409 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:58.405+0000 7fa5f1e36a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-18T01:21:59.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-18T01:21:59.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:21:59.137 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:21:59.137 INFO:tasks.workunit.client.0.trial080.stdout:adding osd0 key to auth repository 2026-02-18T01:21:59.137 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:21:59.251 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:21:59.252 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:21:59.252 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:21:59.252 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:21:59.252 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:21:59.252 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:21:59.270 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:59.265+0000 7fd82f955a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:21:59.271 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:59.265+0000 7fd82f955a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:21:59.272 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:59.265+0000 7fd82f955a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:21:59.366 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:21:59.366 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:21:59.366 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:21:59.366 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:21:59.366 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:21:59.366 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:21:59.366 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:21:59.366 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:21:59.366 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:21:59.366 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:21:59.477 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:21:59.667 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:21:59.661+0000 7fd82f955a40 -1 Falling back to public interface 2026-02-18T01:22:00.479 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:22:00.479 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:22:00.479 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:22:00.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:22:00.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:22:00.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:22:00.511 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:00.505+0000 7fd82f955a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:22:00.594 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:22:01.596 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:22:01.596 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:22:01.596 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:22:01.597 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:22:01.597 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:22:01.597 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:22:01.811 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1664297698,v1:127.0.0.1:6801/1664297698] [v2:127.0.0.1:6802/1664297698,v1:127.0.0.1:6803/1664297698] exists,up 93913594-6b7e-4e41-b650-1ee84f36d147 2026-02-18T01:22:01.815 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:22:01.815 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:22:01.815 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:22:01.815 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-18T01:22:01.815 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 1 2026-02-18T01:22:01.815 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-18T01:22:01.815 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:22:01.815 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T01:22:01.815 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:22:01.815 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-18T01:22:01.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:22:01.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:22:01.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:22:01.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:22:01.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-18T01:22:01.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-18T01:22:01.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:22:01.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:22:01.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:22:01.816 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:22:01.816 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:22:01.816 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:22:01.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:22:01.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:22:01.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:22:01.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:22:01.818 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-18T01:22:01.818 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:22:01.819 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=06b951d7-efc6-4811-9cbd-30f3073451e6 2026-02-18T01:22:01.819 INFO:tasks.workunit.client.0.trial080.stdout:add osd1 06b951d7-efc6-4811-9cbd-30f3073451e6 2026-02-18T01:22:01.819 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 06b951d7-efc6-4811-9cbd-30f3073451e6' 2026-02-18T01:22:01.819 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:22:01.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA5FJVpJp9GMRAAeZuNqNSiuYEjNsloMJvypw== 2026-02-18T01:22:01.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA5FJVpJp9GMRAAeZuNqNSiuYEjNsloMJvypw=="}' 2026-02-18T01:22:01.831 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 06b951d7-efc6-4811-9cbd-30f3073451e6 -i td/divergent-priors/1/new.json 2026-02-18T01:22:02.043 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:22:02.054 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-18T01:22:02.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA5FJVpJp9GMRAAeZuNqNSiuYEjNsloMJvypw== --osd-uuid 06b951d7-efc6-4811-9cbd-30f3073451e6 2026-02-18T01:22:02.082 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:02.077+0000 7f0f1cc8fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:02.083 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:02.077+0000 7f0f1cc8fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:02.084 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:02.077+0000 7f0f1cc8fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:02.085 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:02.077+0000 7f0f1cc8fa40 -1 bdev(0x564ae02e2c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-18T01:22:02.085 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:02.077+0000 7f0f1cc8fa40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-18T01:22:02.768 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-18T01:22:02.768 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:22:02.769 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T01:22:02.769 INFO:tasks.workunit.client.0.trial080.stdout:adding osd1 key to auth repository 2026-02-18T01:22:02.770 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:22:03.060 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:22:03.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T01:22:03.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:22:03.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:22:03.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:22:03.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:22:03.088 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:03.081+0000 7f20ae9e7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:03.090 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:03.085+0000 7f20ae9e7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:03.091 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:03.085+0000 7f20ae9e7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:03.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T01:22:03.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:22:03.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:22:03.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:22:03.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:22:03.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:22:03.277 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:22:03.277 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:22:03.277 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:22:03.278 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:22:03.447 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:03.441+0000 7f20ae9e7a40 -1 Falling back to public interface 2026-02-18T01:22:03.491 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:22:04.104 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:04.097+0000 7f20ae9e7a40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:22:04.492 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:22:04.493 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:22:04.493 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:22:04.494 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:22:04.494 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:22:04.494 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:22:04.705 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:22:05.707 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:22:05.707 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:22:05.707 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:22:05.708 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:22:05.708 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:22:05.708 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:22:05.920 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3526270237,v1:127.0.0.1:6811/3526270237] [v2:127.0.0.1:6812/3526270237,v1:127.0.0.1:6813/3526270237] exists,up 06b951d7-efc6-4811-9cbd-30f3073451e6 2026-02-18T01:22:05.924 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:22:05.924 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:22:05.924 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:22:05.924 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-18T01:22:05.924 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 2 2026-02-18T01:22:05.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-18T01:22:05.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:22:05.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T01:22:05.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:22:05.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-18T01:22:05.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:22:05.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:22:05.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:22:05.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:22:05.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-18T01:22:05.926 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-18T01:22:05.926 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:22:05.926 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:22:05.926 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:22:05.926 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:22:05.926 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:22:05.926 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:22:05.926 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:22:05.926 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:22:05.926 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:22:05.926 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:22:05.926 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:22:05.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:22:05.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:22:05.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:22:05.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:22:05.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:22:05.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:22:05.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:22:05.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:22:05.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:22:05.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:22:05.927 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:22:05.928 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-18T01:22:05.928 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:22:05.928 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0035cdac-f15f-47cf-b751-9feed4d3ddbe 2026-02-18T01:22:05.928 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 0035cdac-f15f-47cf-b751-9feed4d3ddbe' 2026-02-18T01:22:05.929 INFO:tasks.workunit.client.0.trial080.stdout:add osd2 0035cdac-f15f-47cf-b751-9feed4d3ddbe 2026-02-18T01:22:05.929 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:22:05.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA9FJVpTpK4NxAA/jhLTCwBm3Fa4Be3JsftjQ== 2026-02-18T01:22:05.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA9FJVpTpK4NxAA/jhLTCwBm3Fa4Be3JsftjQ=="}' 2026-02-18T01:22:05.939 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0035cdac-f15f-47cf-b751-9feed4d3ddbe -i td/divergent-priors/2/new.json 2026-02-18T01:22:06.164 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:22:06.174 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-18T01:22:06.175 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA9FJVpTpK4NxAA/jhLTCwBm3Fa4Be3JsftjQ== --osd-uuid 0035cdac-f15f-47cf-b751-9feed4d3ddbe 2026-02-18T01:22:06.202 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:06.197+0000 7f7819a08a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:06.204 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:06.197+0000 7f7819a08a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:06.205 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:06.197+0000 7f7819a08a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:06.206 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:06.201+0000 7f7819a08a40 -1 bdev(0x564fd39d8c00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-18T01:22:06.206 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:06.201+0000 7f7819a08a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-18T01:22:06.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-18T01:22:06.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:22:06.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T01:22:06.886 INFO:tasks.workunit.client.0.trial080.stdout:adding osd2 key to auth repository 2026-02-18T01:22:06.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:22:07.188 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T01:22:07.188 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:22:07.189 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:22:07.189 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:22:07.189 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:22:07.189 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:22:07.206 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:07.201+0000 7fcd08a63a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:07.208 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:07.201+0000 7fcd08a63a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:07.209 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:07.201+0000 7fcd08a63a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:07.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T01:22:07.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:22:07.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:22:07.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:22:07.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:22:07.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:22:07.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:22:07.405 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:22:07.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:22:07.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:22:07.531 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:07.525+0000 7fcd08a63a40 -1 Falling back to public interface 2026-02-18T01:22:07.618 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:22:08.194 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:08.189+0000 7fcd08a63a40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:22:08.619 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:22:08.620 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:22:08.620 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:22:08.621 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:22:08.621 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:22:08.621 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:22:08.828 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/886884953,v1:127.0.0.1:6819/886884953] [v2:127.0.0.1:6820/886884953,v1:127.0.0.1:6821/886884953] exists,up 0035cdac-f15f-47cf-b751-9feed4d3ddbe 2026-02-18T01:22:08.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:22:08.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:22:08.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:22:08.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:242: TEST_divergent_ec: ceph osd set noout 2026-02-18T01:22:09.109 INFO:tasks.workunit.client.0.trial080.stderr:noout is set 2026-02-18T01:22:09.120 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:243: TEST_divergent_ec: ceph osd set noin 2026-02-18T01:22:09.415 INFO:tasks.workunit.client.0.trial080.stderr:noin is set 2026-02-18T01:22:09.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:244: TEST_divergent_ec: ceph osd set nodown 2026-02-18T01:22:09.719 INFO:tasks.workunit.client.0.trial080.stderr:nodown is set 2026-02-18T01:22:09.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:245: TEST_divergent_ec: create_ec_pool test true k=2 m=1 2026-02-18T01:22:09.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: local pool_name=test 2026-02-18T01:22:09.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: shift 2026-02-18T01:22:09.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: local allow_overwrites=true 2026-02-18T01:22:09.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2525: create_ec_pool: shift 2026-02-18T01:22:09.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2527: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-18T01:22:09.987 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2529: create_ec_pool: create_pool test 1 1 erasure myprofile 2026-02-18T01:22:09.988 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2026-02-18T01:22:10.347 INFO:tasks.workunit.client.0.trial080.stderr:pool 'test' already exists 2026-02-18T01:22:10.357 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T01:22:11.358 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: '[' true = true ']' 2026-02-18T01:22:11.358 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2532: create_ec_pool: ceph osd pool set test allow_ec_overwrites true 2026-02-18T01:22:11.626 INFO:tasks.workunit.client.0.trial080.stderr:set pool 1 allow_ec_overwrites to true 2026-02-18T01:22:11.638 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: wait_for_clean 2026-02-18T01:22:11.638 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:22:11.638 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:22:11.638 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:22:11.639 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:22:11.639 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:22:11.639 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:22:11.639 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:22:11.639 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:22:11.640 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:22:11.730 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:22:11.730 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:22:11.730 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:22:11.730 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:22:11.730 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:22:11.730 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:22:11.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:22:11.950 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:22:11.950 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:22:11.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:22:11.951 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:11.951 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:22:12.029 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-18T01:22:12.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-18T01:22:12.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485' 2026-02-18T01:22:12.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:12.030 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:22:12.109 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-18T01:22:12.109 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-18T01:22:12.109 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-18T01:22:12.109 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:12.109 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:22:12.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509443 2026-02-18T01:22:12.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509443 2026-02-18T01:22:12.190 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-42949672964 2-64424509443' 2026-02-18T01:22:12.191 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:12.191 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-18T01:22:12.191 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:12.192 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:22:12.193 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836485 2026-02-18T01:22:12.193 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:12.194 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836485 2026-02-18T01:22:12.194 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-18T01:22:12.195 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836485 2026-02-18T01:22:12.195 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:22:12.409 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-18T01:22:12.410 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:22:13.411 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:22:13.411 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:22:13.629 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-18T01:22:13.629 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:13.630 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-18T01:22:13.630 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:13.631 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:22:13.633 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672964 2026-02-18T01:22:13.634 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:13.634 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672964 2026-02-18T01:22:13.634 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 42949672964 2026-02-18T01:22:13.635 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-18T01:22:13.635 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:22:13.865 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-18T01:22:13.865 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:13.865 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509443 2026-02-18T01:22:13.866 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:13.866 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:22:13.867 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-64424509443 2026-02-18T01:22:13.867 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:13.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=64424509443 2026-02-18T01:22:13.869 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 64424509443 2026-02-18T01:22:13.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-18T01:22:13.869 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:22:14.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509443 -lt 64424509443 2026-02-18T01:22:14.089 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:22:14.089 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:14.089 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:14.365 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:22:14.365 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:22:14.365 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:22:14.365 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:22:14.365 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:22:14.365 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:22:14.365 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:22:14.365 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:22:14.573 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-18T01:22:14.574 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:22:14.574 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:14.574 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:14.856 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-18T01:22:14.856 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:22:14.856 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:22:14.856 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2536: create_ec_pool: return 0 2026-02-18T01:22:14.856 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:247: TEST_divergent_ec: flush_pg_stats 2026-02-18T01:22:14.856 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:22:14.856 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:22:15.075 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:22:15.075 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:22:15.075 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:22:15.076 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:22:15.076 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:15.076 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:22:15.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-18T01:22:15.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-18T01:22:15.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-18T01:22:15.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:15.157 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:22:15.238 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-18T01:22:15.239 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-18T01:22:15.239 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-42949672966' 2026-02-18T01:22:15.239 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:15.239 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:22:15.316 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509446 2026-02-18T01:22:15.316 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509446 2026-02-18T01:22:15.316 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-42949672966 2-64424509446' 2026-02-18T01:22:15.317 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:15.317 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-18T01:22:15.317 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:15.318 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:22:15.319 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-18T01:22:15.319 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:15.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-18T01:22:15.321 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836487 2026-02-18T01:22:15.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-18T01:22:15.321 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:22:15.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-18T01:22:15.538 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:22:16.539 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:22:16.540 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:22:16.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-18T01:22:16.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:16.751 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-18T01:22:16.751 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:16.752 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:22:16.753 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672966 2026-02-18T01:22:16.753 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:16.754 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672966 2026-02-18T01:22:16.754 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 42949672966 2026-02-18T01:22:16.754 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-18T01:22:16.755 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:22:16.974 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672967 -lt 42949672966 2026-02-18T01:22:16.975 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:16.975 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509446 2026-02-18T01:22:16.975 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:16.976 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:22:16.977 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-64424509446 2026-02-18T01:22:16.977 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:16.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=64424509446 2026-02-18T01:22:16.979 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 64424509446 2026-02-18T01:22:16.979 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2026-02-18T01:22:16.979 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:22:17.202 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509446 -lt 64424509446 2026-02-18T01:22:17.202 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:248: TEST_divergent_ec: wait_for_clean 2026-02-18T01:22:17.203 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:22:17.203 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:22:17.203 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:22:17.203 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:22:17.204 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:22:17.204 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:22:17.204 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:22:17.204 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:22:17.204 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:22:17.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:22:17.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:22:17.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:22:17.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:22:17.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:22:17.309 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:22:17.525 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:22:17.525 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:22:17.525 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:22:17.525 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:22:17.525 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:17.525 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:22:17.608 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-18T01:22:17.608 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-18T01:22:17.609 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490' 2026-02-18T01:22:17.609 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:17.609 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:22:17.691 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672969 2026-02-18T01:22:17.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672969 2026-02-18T01:22:17.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-42949672969' 2026-02-18T01:22:17.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:17.692 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:22:17.770 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509448 2026-02-18T01:22:17.770 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509448 2026-02-18T01:22:17.770 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-42949672969 2-64424509448' 2026-02-18T01:22:17.770 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:17.771 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-18T01:22:17.771 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:17.771 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:22:17.772 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836490 2026-02-18T01:22:17.772 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:17.774 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836490 2026-02-18T01:22:17.774 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836490 2026-02-18T01:22:17.774 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-18T01:22:17.775 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:22:17.989 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836490 2026-02-18T01:22:17.989 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:22:18.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:22:18.991 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:22:19.202 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-18T01:22:19.203 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:19.203 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672969 2026-02-18T01:22:19.203 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:19.204 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:22:19.205 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672969 2026-02-18T01:22:19.205 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:19.206 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672969 2026-02-18T01:22:19.207 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2026-02-18T01:22:19.207 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 42949672969 2026-02-18T01:22:19.207 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:22:19.428 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672969 -lt 42949672969 2026-02-18T01:22:19.428 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:19.429 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509448 2026-02-18T01:22:19.429 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:19.430 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:22:19.430 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-64424509448 2026-02-18T01:22:19.431 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:19.432 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=64424509448 2026-02-18T01:22:19.432 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 64424509448 2026-02-18T01:22:19.433 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 64424509448' 2026-02-18T01:22:19.433 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:22:19.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509448 -lt 64424509448 2026-02-18T01:22:19.656 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:22:19.656 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:19.656 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:19.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:22:19.936 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:22:19.936 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:22:19.936 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:22:19.936 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:22:19.936 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:22:19.936 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:22:19.937 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:22:20.143 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-18T01:22:20.143 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:22:20.144 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:20.144 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:20.424 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-18T01:22:20.424 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:22:20.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:22:20.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: jq '.pg_stats[0].up_primary' 2026-02-18T01:22:20.425 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: ceph pg dump pgs --format=json 2026-02-18T01:22:20.626 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:22:20.635 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: local divergent=1 2026-02-18T01:22:20.635 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: echo 'primary and soon to be divergent is 1' 2026-02-18T01:22:20.635 INFO:tasks.workunit.client.0.trial080.stdout:primary and soon to be divergent is 1 2026-02-18T01:22:20.636 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:253: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:22:20.839 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:22:20.840 INFO:tasks.workunit.client.0.trial080.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T01:22:11.354376+0000 0'0 29:20 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:21:25.492514+0000 0 0 2026-02-18T01:22:20.840 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:22:20.840 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:22:20.840 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:22:20.850 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:254: TEST_divergent_ec: local non_divergent= 2026-02-18T01:22:20.850 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-18T01:22:20.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 0 = 1 ']' 2026-02-18T01:22:20.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0' 2026-02-18T01:22:20.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-18T01:22:20.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 1 = 1 ']' 2026-02-18T01:22:20.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: continue 2026-02-18T01:22:20.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-18T01:22:20.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 2 = 1 ']' 2026-02-18T01:22:20.851 INFO:tasks.workunit.client.0.trial080.stdout:writing initial objects 2026-02-18T01:22:20.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0 2' 2026-02-18T01:22:20.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:263: TEST_divergent_ec: echo 'writing initial objects' 2026-02-18T01:22:20.852 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: seq 1 100 2026-02-18T01:22:20.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:20.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_1 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:20.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:20.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_2 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:20.901 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:20.901 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_3 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:20.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:20.925 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:20.953 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:20.953 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_5 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:20.982 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:20.982 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_6 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.010 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_7 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.038 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.038 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_8 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.067 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.067 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_9 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.095 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.096 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_10 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.116 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.116 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_11 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.144 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.144 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_12 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_13 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.200 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.200 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_14 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.228 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.228 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_15 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.247 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_16 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.275 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.275 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_17 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.301 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.301 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_18 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.326 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.326 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_19 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.346 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.346 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_20 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_21 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.400 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.400 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_22 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.429 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_23 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.458 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_24 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_25 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.514 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.514 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_26 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_27 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_28 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.599 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_29 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.628 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.628 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_30 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_31 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.683 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.684 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_32 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.712 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.712 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_33 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.740 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.740 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_34 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.760 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.760 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_35 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.789 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.790 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_36 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_37 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.845 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.845 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_38 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.874 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_39 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.902 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.902 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_40 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.930 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.930 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_41 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_42 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:21.986 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:21.987 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_43 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.015 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.015 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_44 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.043 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.043 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_45 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.071 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.071 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_46 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.099 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.100 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_47 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_48 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.155 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.155 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_49 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.184 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.184 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_50 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.211 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.211 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_51 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.240 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.240 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_52 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.267 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.267 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_53 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.294 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.294 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_54 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.322 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.322 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_55 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.350 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_56 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.378 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.379 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_57 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.399 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.399 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_58 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_59 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.452 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.453 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_60 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_61 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.509 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.509 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_62 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.537 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_63 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_64 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_65 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.620 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.620 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_66 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.648 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.648 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_67 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_68 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.697 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.697 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_69 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.723 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.723 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_70 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_71 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.772 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.772 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_72 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_73 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.826 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.826 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_74 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_75 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.875 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_76 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.903 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_77 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.931 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.931 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_78 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_79 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:22.987 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:22.988 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_80 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.015 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.015 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_81 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.042 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.042 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_82 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.070 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.070 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_83 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.098 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.098 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_84 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_85 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.147 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.148 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_86 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.168 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.168 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_87 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.195 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.195 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_88 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.220 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.220 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_89 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.246 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.247 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_90 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.274 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.274 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_91 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_92 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.327 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.327 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_93 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.355 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.355 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_94 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.383 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.383 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_95 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.403 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.403 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_96 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.430 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.430 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_97 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.456 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.456 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_98 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.485 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-18T01:22:23.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:23.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-18T01:22:23.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: wait_for_clean 2026-02-18T01:22:23.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:22:23.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:22:23.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:22:23.535 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-18T01:22:23.535 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:22:23.535 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:22:23.535 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:22:23.535 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:22:23.535 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:22:23.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-18T01:22:23.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:22:23.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:22:23.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:22:23.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:22:23.608 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:22:23.824 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:22:23.824 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:22:23.824 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:22:23.824 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:22:23.824 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:23.824 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:22:23.905 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836493 2026-02-18T01:22:23.905 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836493 2026-02-18T01:22:23.905 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836493' 2026-02-18T01:22:23.906 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:23.906 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:22:23.989 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672972 2026-02-18T01:22:23.989 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672972 2026-02-18T01:22:23.989 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836493 1-42949672972' 2026-02-18T01:22:23.989 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:23.989 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:22:24.074 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509451 2026-02-18T01:22:24.074 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509451 2026-02-18T01:22:24.074 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836493 1-42949672972 2-64424509451' 2026-02-18T01:22:24.074 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:24.074 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836493 2026-02-18T01:22:24.075 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:24.075 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:22:24.076 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836493 2026-02-18T01:22:24.076 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:24.078 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836493 2026-02-18T01:22:24.078 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-18T01:22:24.078 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 21474836493 2026-02-18T01:22:24.079 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:22:24.288 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836493 2026-02-18T01:22:24.288 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:22:25.290 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:22:25.290 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:22:25.513 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-18T01:22:25.513 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:25.514 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672972 2026-02-18T01:22:25.514 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:25.514 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:22:25.515 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672972 2026-02-18T01:22:25.515 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:25.517 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672972 2026-02-18T01:22:25.517 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 42949672972 2026-02-18T01:22:25.517 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672972' 2026-02-18T01:22:25.518 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:22:25.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672972 -lt 42949672972 2026-02-18T01:22:25.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:25.729 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509451 2026-02-18T01:22:25.729 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:25.730 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:22:25.731 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-64424509451 2026-02-18T01:22:25.731 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:25.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=64424509451 2026-02-18T01:22:25.732 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 64424509451 2026-02-18T01:22:25.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 64424509451' 2026-02-18T01:22:25.733 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:22:25.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509452 -lt 64424509451 2026-02-18T01:22:25.961 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:22:25.962 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:25.962 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:26.247 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:22:26.247 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:22:26.247 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:22:26.247 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:22:26.247 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:22:26.247 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:22:26.247 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:22:26.247 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:22:26.458 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-18T01:22:26.459 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:22:26.459 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:26.459 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:26.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-18T01:22:26.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:22:26.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:22:26.739 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: get_pg test existing_1 2026-02-18T01:22:26.739 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-18T01:22:26.739 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-18T01:22:26.740 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-18T01:22:26.740 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-18T01:22:26.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: local pgid=1.0 2026-02-18T01:22:26.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:275: TEST_divergent_ec: echo 'blackholing osds 0 2' 2026-02-18T01:22:26.950 INFO:tasks.workunit.client.0.trial080.stdout:blackholing osds 0 2 2026-02-18T01:22:26.950 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:276: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:22:27.152 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:22:27.152 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-18T01:22:11.354376+0000 29'100 29:120 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:21:25.492514+0000 0 0 2026-02-18T01:22:27.152 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:22:27.152 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:22:27.152 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:22:27.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-18T01:22:27.161 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.0 2026-02-18T01:22:27.161 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T01:22:27.161 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T01:22:27.162 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:22:27.162 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:22:27.162 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:22:27.162 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.0.asok 2026-02-18T01:22:27.163 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-18T01:22:27.163 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-18T01:22:27.217 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:22:27.217 INFO:tasks.workunit.client.0.trial080.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-18T01:22:27.217 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:22:27.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-18T01:22:27.224 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.2 2026-02-18T01:22:27.224 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-18T01:22:27.224 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-18T01:22:27.225 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:22:27.225 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:22:27.225 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:22:27.225 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.2.asok 2026-02-18T01:22:27.225 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-18T01:22:27.225 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-18T01:22:27.291 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:22:27.291 INFO:tasks.workunit.client.0.trial080.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-18T01:22:27.291 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:22:27.297 INFO:tasks.workunit.client.0.trial080.stdout:writing divergent object 2026-02-18T01:22:27.297 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:283: TEST_divergent_ec: echo 'writing divergent object' 2026-02-18T01:22:27.297 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:285: TEST_divergent_ec: sleep 1 2026-02-18T01:22:27.297 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:284: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.TjYHSp1N4J 2026-02-18T01:22:28.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:287: TEST_divergent_ec: rados -p test mksnap snap1 2026-02-18T01:22:28.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:286: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:28.368 INFO:tasks.workunit.client.0.trial080.stdout:created pool test snap snap1 2026-02-18T01:22:28.370 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: sleep 10 2026-02-18T01:22:28.371 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: expr 100 - 1 2026-02-18T01:22:28.372 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.U1sUw4n52M 2026-02-18T01:22:38.372 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:290: TEST_divergent_ec: killall -9 rados 2026-02-18T01:22:38.416 INFO:tasks.workunit.client.0.trial080.stderr:rados: no process found 2026-02-18T01:22:38.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:293: TEST_divergent_ec: echo 'killing all the osds' 2026-02-18T01:22:38.416 INFO:tasks.workunit.client.0.trial080.stdout:killing all the osds 2026-02-18T01:22:38.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:294: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:22:38.621 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:22:38.622 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 active+clean 2026-02-18T01:22:11.354376+0000 30'104 30:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 periodic scrub scheduled @ 2026-02-19T11:33:22.730043+0000 0 0 2026-02-18T01:22:38.622 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:22:38.622 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:22:38.622 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:22:38.630 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:295: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd 2026-02-18T01:22:38.631 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:22:38.631 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:22:38.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:22:38.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:22:38.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:22:38.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:22:38.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-18T01:22:38.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.0 2026-02-18T01:22:39.003 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already down. 2026-02-18T01:22:39.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-18T01:22:39.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.1 2026-02-18T01:22:39.288 INFO:tasks.workunit.client.0.trial080.stderr:osd.1 is already down. 2026-02-18T01:22:39.297 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-18T01:22:39.297 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.2 2026-02-18T01:22:39.571 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already down. 2026-02-18T01:22:39.580 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-18T01:22:39.580 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.0 2026-02-18T01:22:39.859 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already out. 2026-02-18T01:22:39.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-18T01:22:39.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.2 2026-02-18T01:22:40.149 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already out. 2026-02-18T01:22:40.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:306: TEST_divergent_ec: echo 'bringing up non_divergent 0 2' 2026-02-18T01:22:40.160 INFO:tasks.workunit.client.0.trial080.stdout:bringing up non_divergent 0 2 2026-02-18T01:22:40.161 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:307: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:22:40.362 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:22:40.362 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 stale+active+clean 2026-02-18T01:22:11.354376+0000 30'104 30:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 periodic scrub scheduled @ 2026-02-19T11:33:22.730043+0000 0 0 2026-02-18T01:22:40.362 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:22:40.362 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:22:40.363 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:22:40.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-18T01:22:40.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-18T01:22:40.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:22:40.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:22:40.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:22:40.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:22:40.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-18T01:22:40.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:22:40.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:22:40.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:22:40.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:22:40.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-18T01:22:40.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-18T01:22:40.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:22:40.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:22:40.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:22:40.376 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:22:40.376 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:22:40.376 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:22:40.376 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:22:40.376 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:22:40.377 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:22:40.377 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:22:40.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:22:40.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:22:40.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:22:40.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:22:40.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:22:40.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:22:40.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:22:40.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:22:40.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:22:40.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:22:40.378 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-18T01:22:40.378 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:22:40.379 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:22:40.379 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:22:40.379 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-18T01:22:40.379 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:22:40.379 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:22:40.380 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:22:40.380 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:22:40.399 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:40.392+0000 7f5eadf5aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:40.401 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:40.392+0000 7f5eadf5aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:40.402 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:40.392+0000 7f5eadf5aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:40.596 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:22:40.596 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:22:40.596 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:22:40.597 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:22:40.597 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:22:40.597 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:22:40.597 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:22:40.597 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:22:40.597 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:22:40.597 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:22:40.809 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:22:40.827 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:40.820+0000 7f5eadf5aa40 -1 Falling back to public interface 2026-02-18T01:22:41.528 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:41.520+0000 7f5eadf5aa40 -1 osd.0 29 log_to_monitors true 2026-02-18T01:22:41.810 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:22:41.811 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:22:41.811 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:22:41.812 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:22:41.812 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:22:41.812 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:22:42.029 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up out weight 0 up_from 37 up_thru 0 down_at 31 last_clean_interval [5,29) [v2:127.0.0.1:6800/890539449,v1:127.0.0.1:6801/890539449] [v2:127.0.0.1:6802/890539449,v1:127.0.0.1:6803/890539449] exists,up 93913594-6b7e-4e41-b650-1ee84f36d147 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:22:42.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:22:42.031 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:22:42.031 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:22:42.031 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:22:42.031 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:22:42.031 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:22:42.031 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:22:42.031 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:22:42.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:22:42.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:22:42.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:22:42.031 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:22:42.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:22:42.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:22:42.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:22:42.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:22:42.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:22:42.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:22:42.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-18T01:22:42.032 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T01:22:42.032 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:22:42.033 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:22:42.033 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-18T01:22:42.034 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T01:22:42.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:22:42.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:22:42.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:22:42.054 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:42.048+0000 7f4dd51f3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:42.055 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:42.048+0000 7f4dd51f3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:42.056 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:42.048+0000 7f4dd51f3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:22:42.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T01:22:42.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:22:42.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:22:42.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:22:42.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:22:42.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:22:42.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:22:42.249 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:22:42.249 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:22:42.249 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:22:42.440 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:42.432+0000 7f4dd51f3a40 -1 Falling back to public interface 2026-02-18T01:22:42.469 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:22:43.132 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:22:43.124+0000 7f4dd51f3a40 -1 osd.2 29 log_to_monitors true 2026-02-18T01:22:43.471 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:22:43.471 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:22:43.471 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:22:43.472 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:22:43.472 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:22:43.472 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:22:43.686 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up out weight 0 up_from 39 up_thru 0 down_at 33 last_clean_interval [15,29) [v2:127.0.0.1:6810/2949797900,v1:127.0.0.1:6811/2949797900] [v2:127.0.0.1:6812/2949797900,v1:127.0.0.1:6813/2949797900] exists,up 0035cdac-f15f-47cf-b751-9feed4d3ddbe 2026-02-18T01:22:43.687 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:22:43.687 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:22:43.687 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:22:43.687 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-18T01:22:43.687 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.0 2026-02-18T01:22:43.935 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already in. 2026-02-18T01:22:43.945 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-18T01:22:43.945 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.2 2026-02-18T01:22:44.223 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already in. 2026-02-18T01:22:44.233 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:317: TEST_divergent_ec: sleep 5 2026-02-18T01:22:49.235 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: expr 2 + 2 2026-02-18T01:22:49.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: objname=existing_4 2026-02-18T01:22:49.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: echo 'writing non-divergent object existing_4' 2026-02-18T01:22:49.237 INFO:tasks.workunit.client.0.trial080.stdout:writing non-divergent object existing_4 2026-02-18T01:22:49.237 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:323: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:22:49.435 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:22:49.435 INFO:tasks.workunit.client.0.trial080.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-18T01:22:44.270014+0000 29'100 42:130 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 periodic scrub scheduled @ 2026-02-19T03:28:41.205110+0000 0 0 2026-02-18T01:22:49.435 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:22:49.435 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:22:49.435 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:22:49.444 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:324: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.TjYHSp1N4J 2026-02-18T01:22:49.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:325: TEST_divergent_ec: rm -f /tmp/tmp.TjYHSp1N4J 2026-02-18T01:22:49.476 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-18T01:22:49.476 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: wait_for_clean 2026-02-18T01:22:49.476 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:22:49.476 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:22:49.476 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:22:49.476 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-18T01:22:49.477 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:22:49.477 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:22:49.477 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:22:49.477 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:22:49.477 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:22:49.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-18T01:22:49.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:22:49.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:22:49.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:22:49.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:22:49.550 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:22:49.769 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:22:49.769 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:22:49.769 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:22:49.769 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:22:49.769 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:49.769 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:22:49.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789956 2026-02-18T01:22:49.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789956 2026-02-18T01:22:49.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-158913789956' 2026-02-18T01:22:49.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:49.854 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:22:49.913 INFO:tasks.workunit.client.0.trial080.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-18T01:22:49.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-18T01:22:49.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-18T01:22:49.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-18T01:22:49.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:22:49.916 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:22:50.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724548 2026-02-18T01:22:50.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724548 2026-02-18T01:22:50.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-158913789956 2-167503724548' 2026-02-18T01:22:50.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:50.010 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-158913789956 2026-02-18T01:22:50.010 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:50.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:22:50.011 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-158913789956 2026-02-18T01:22:50.012 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:50.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789956 2026-02-18T01:22:50.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 158913789956' 2026-02-18T01:22:50.013 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 158913789956 2026-02-18T01:22:50.013 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:22:50.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789954 -lt 158913789956 2026-02-18T01:22:50.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:22:51.242 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:22:51.243 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:22:51.453 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789956 -lt 158913789956 2026-02-18T01:22:51.454 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:22:51.454 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-167503724548 2026-02-18T01:22:51.454 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:22:51.456 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:22:51.457 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-167503724548 2026-02-18T01:22:51.457 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:22:51.458 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=167503724548 2026-02-18T01:22:51.458 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 167503724548 2026-02-18T01:22:51.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 167503724548' 2026-02-18T01:22:51.459 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:22:51.676 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 167503724548 -lt 167503724548 2026-02-18T01:22:51.677 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:22:51.677 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:51.678 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:51.968 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:22:51.969 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:22:51.969 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:22:51.969 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:22:51.969 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:22:51.969 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:22:51.969 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:22:51.969 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:22:52.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:22:52.182 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:22:52.182 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:52.182 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:52.462 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:22:52.462 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-18T01:22:52.462 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-18T01:22:52.462 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-18T01:22:52.462 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:22:52.462 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-18T01:22:52.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:22:52.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:22:52.564 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:22:52.564 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:22:52.564 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:22:52.564 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:22:52.564 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:22:52.564 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:22:52.776 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:22:52.777 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:22:52.777 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:52.777 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:53.058 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:22:53.058 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:22:53.058 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:22:53.058 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:22:53.058 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:22:53.058 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:22:53.058 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:22:53.059 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:22:53.059 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:22:53.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:22:53.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:22:53.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-18T01:22:53.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:22:53.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-18T01:22:53.538 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:22:53.539 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:22:53.539 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:22:53.540 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:22:53.540 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:22:53.540 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:22:53.540 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:22:53.540 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:22:53.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:22:53.751 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:22:53.752 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:53.752 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:54.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:22:54.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:22:54.036 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:22:54.036 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:22:54.036 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:22:54.036 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:22:54.036 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:22:54.036 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:22:54.037 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:22:54.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:22:54.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:22:54.322 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-18T01:22:54.322 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:22:54.322 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-18T01:22:54.722 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:22:54.722 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:22:54.722 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:22:54.722 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:22:54.722 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:22:54.722 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:22:54.723 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:22:54.723 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:22:54.931 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:22:54.932 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:22:54.932 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:54.933 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:55.211 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:22:55.211 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:22:55.212 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:22:55.212 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:22:55.212 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:22:55.212 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:22:55.212 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:22:55.212 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:22:55.212 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:22:55.500 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:22:55.500 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:22:55.500 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-18T01:22:55.500 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:22:55.500 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-18T01:22:56.301 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:22:56.301 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:22:56.302 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:22:56.303 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:22:56.303 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:22:56.303 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:22:56.303 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:22:56.303 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:22:56.516 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:22:56.516 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:22:56.517 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:56.517 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:56.799 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:22:56.799 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:22:56.799 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:22:56.799 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:22:56.799 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:22:56.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:22:56.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:22:56.800 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:22:56.800 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:22:57.084 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:22:57.084 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:22:57.084 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-18T01:22:57.084 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:22:57.084 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-18T01:22:58.685 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:22:58.685 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:22:58.686 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:22:58.686 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:22:58.686 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:22:58.686 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:22:58.686 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:22:58.687 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:22:58.898 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:22:58.899 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:22:58.899 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:22:58.899 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:22:59.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:22:59.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:22:59.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:22:59.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:22:59.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:22:59.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:22:59.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:22:59.186 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:22:59.186 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:22:59.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:22:59.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:22:59.476 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-18T01:22:59.476 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:22:59.476 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-18T01:23:02.676 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:23:02.676 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:23:02.677 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:23:02.677 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:23:02.677 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:23:02.678 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:23:02.678 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:23:02.678 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:23:02.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:23:02.891 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:23:02.892 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:02.892 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:03.173 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:23:03.173 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:23:03.174 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:23:03.174 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:23:03.174 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:23:03.174 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:23:03.174 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:23:03.174 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:23:03.174 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:23:03.462 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:23:03.462 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:23:03.463 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-18T01:23:03.463 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:23:03.463 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-18T01:23:09.863 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:23:09.864 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:23:09.865 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:23:09.865 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:23:09.865 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:23:09.865 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:23:09.865 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:23:09.865 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:23:10.078 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:23:10.079 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:23:10.079 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:10.079 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:10.367 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:23:10.368 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:23:10.368 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:23:10.368 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:23:10.368 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:23:10.368 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:23:10.368 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:23:10.368 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:23:10.368 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:23:10.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:23:10.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:23:10.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-18T01:23:10.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:23:10.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-18T01:23:17.956 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:23:17.956 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:23:17.957 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:23:17.957 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:23:17.958 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:23:17.958 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:23:17.958 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:23:17.958 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:23:18.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:23:18.170 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:23:18.170 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:18.170 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:18.455 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:23:18.455 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:23:18.455 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:23:18.455 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:23:18.455 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:23:18.455 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:23:18.455 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:23:18.456 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:23:18.456 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:23:18.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:23:18.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:23:18.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-18T01:23:18.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-18T01:23:19.020 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:23:19.020 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_fingerprint": "a35ff708-712e-4af3-8f8e-d33b22bbe76a", 2026-02-18T01:23:19.020 INFO:tasks.workunit.client.0.trial080.stdout: "version": "20.2.0-670-gadc19233", 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "commit": "adc1923395f2bcd6ae89b5d331d278364d1848ed", 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "timestamp": "2026-02-18T01:23:19.015557+0000", 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "tag": "", 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "health": { 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "status": "HEALTH_WARN", 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "checks": { 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "OSDMAP_FLAGS": { 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "count": 17 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [], 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "OSD_DOWN": { 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "message": "1 osds down", 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "count": 1 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "message": "osd.1 (root=default,host=trial080) is down" 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "PG_DEGRADED": { 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:23:19.021 INFO:tasks.workunit.client.0.trial080.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "count": 1 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "mutes": [] 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_first_committed": 1, 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_last_committed": 1, 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "monmap": { 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:21:57.951530Z", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:21:57.951530Z", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release": 20, 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release_name": "tentacle", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "election_strategy": 1, 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "disallowed_leaders": "", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": false, 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "tiebreaker_mon": "", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "removed_ranks": "", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "features": { 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "persistent": [ 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "kraken", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "luminous", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "mimic", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap-prune", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "nautilus", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "octopus", 2026-02-18T01:23:19.022 INFO:tasks.workunit.client.0.trial080.stdout: "pacific", 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "elector-pinging", 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "quincy", 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "reef", 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "squid", 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "tentacle", 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "nvmeof_beacon_diff" 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "optional": [] 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "mons": [ 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "rank": 0, 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "name": "a", 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115", 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 0 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115/0", 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "priority": 0, 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 0, 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "crush_location": "{}" 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "quorum": [ 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: 0 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap": { 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 42, 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:23:19.023 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:21:58.031906+0000", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:22:44.267347+0000", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "last_up_change": "2026-02-18T01:22:43.283477+0000", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "last_in_change": "2026-02-18T01:22:44.164432+0000", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "flags_num": 5800384, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "flags_set": [ 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "nodown", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "noin", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "noout", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "pglog_hardlimit", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snapdirs", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "recovery_deletes", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "sortbitwise" 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "crush_version": 10, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "full_ratio": 0.99000000953674316, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_snapshot": "", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "pool_max": 1, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "max_osd": 3, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "require_min_compat_client": "luminous", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "min_compat_client": "jewel", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "require_osd_release": "tentacle", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "allow_crimson": false, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "pools": [ 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "pool_name": "test", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "create_time": "2026-02-18T01:22:10.201498+0000", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "flags": 16389, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "type": 3, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "size": 3, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "min_size": 2, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "crush_rule": 1, 2026-02-18T01:23:19.024 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_count": 0, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_target": 0, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_barrier": 0, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "is_stretch_pool": false, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "object_hash": 2, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "pg_autoscale_mode": "off", 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num": 1, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num": 1, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num_target": 1, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_target": 1, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_pending": 1, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "last_pg_merge_meta": { 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "source_pgid": "0.0", 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "ready_epoch": 0, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_started": 0, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": 0, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "source_version": "0'0", 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "target_version": "0'0" 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "last_change": "30", 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend": "0", 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_preluminous": "0", 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "auid": 0, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "snap_mode": "pool", 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "snap_seq": 1, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "snap_epoch": 30, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "pool_snaps": [ 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "snapid": 1, 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "stamp": "2026-02-18T01:22:28.312865+0000", 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "name": "snap1" 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps": "[]", 2026-02-18T01:23:19.025 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_bytes": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_objects": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "tiers": [], 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "tier_of": -1, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "read_tier": -1, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "write_tier": -1, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "cache_mode": "none", 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_bytes": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_objects": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_flush_age": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_evict_age": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profile": "myprofile", 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_params": { 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "type": "none" 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_period": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_count": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "use_gmt_hitset": true, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "min_read_recency_for_promote": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "min_write_recency_for_promote": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_grade_decay_rate": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_search_last_n": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "grade_table": [], 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "stripe_width": 8192, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "expected_num_objects": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "fast_read": false, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "nonprimary_shards": "{}", 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "options": {}, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "application_metadata": {} 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "osds": [ 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "93913594-6b7e-4e41-b650-1ee84f36d147", 2026-02-18T01:23:19.026 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 5, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 29, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 37, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 41, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 31, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6800", 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 890539449 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6801", 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 890539449 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6802", 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 890539449 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6803", 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 890539449 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.027 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6806", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 890539449 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6807", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 890539449 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6804", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 890539449 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6805", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 890539449 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6801/890539449", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6803/890539449", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6807/890539449", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6805/890539449", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.028 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "06b951d7-efc6-4811-9cbd-30f3073451e6", 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "up": 0, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 0, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 0, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 10, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 25, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 32, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.029 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/3526270237", 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/3526270237", 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3526270237", 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3526270237", 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: "exists" 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.030 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "0035cdac-f15f-47cf-b751-9feed4d3ddbe", 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 15, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 29, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 39, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 0, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 33, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2949797900 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2949797900 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2949797900 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2949797900 2026-02-18T01:23:19.031 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2949797900 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2949797900 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2949797900 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2949797900 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/2949797900", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/2949797900", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2949797900", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2949797900", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:23:19.032 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "osd_xinfo": [ 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:22:38.944804+0000", 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:22:01.475012+0000", 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:22:39.228860+0000", 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:22:05.064693+0000", 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:22:39.511947+0000", 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:22:09.144634+0000", 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap": [], 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_items": [], 2026-02-18T01:23:19.033 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_primaries": [], 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "pg_temp": [], 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "primary_temp": [], 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "blocklist": {}, 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "range_blocklist": {}, 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profiles": { 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "default": { 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "k": "2", 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "m": "2", 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "plugin": "isa", 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "technique": "reed_sol_van" 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "myprofile": { 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "crush-device-class": "", 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "crush-failure-domain": "osd", 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "crush-num-failure-domains": "0", 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "crush-osds-per-failure-domain": "0", 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "crush-root": "default", 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "k": "2", 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "m": "1", 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "plugin": "isa", 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "technique": "reed_sol_van" 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps_queue": [], 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "new_removed_snaps": [], 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "new_purged_snaps": [], 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "crush_node_flags": {}, 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "device_class_flags": {}, 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": { 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_enabled": false, 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_bucket_count": 0, 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "degraded_stretch_mode": 0, 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "recovering_stretch_mode": 0, 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_bucket": 0 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: "osd_metadata": [ 2026-02-18T01:23:19.034 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6802/890539449,v1:127.0.0.1:6803/890539449]", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:21:59.017235Z", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6800/890539449,v1:127.0.0.1:6801/890539449]", 2026-02-18T01:23:19.035 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/890539449,v1:127.0.0.1:6807/890539449]", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/890539449,v1:127.0.0.1:6805/890539449]", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/0", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/3526270237,v1:127.0.0.1:6813/3526270237]", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:23:19.036 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:22:02.654273Z", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/3526270237,v1:127.0.0.1:6811/3526270237]", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3526270237,v1:127.0.0.1:6817/3526270237]", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3526270237,v1:127.0.0.1:6815/3526270237]", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/1", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:23:19.037 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/2949797900,v1:127.0.0.1:6813/2949797900]", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:22:06.773268Z", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/2949797900,v1:127.0.0.1:6811/2949797900]", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2949797900,v1:127.0.0.1:6817/2949797900]", 2026-02-18T01:23:19.038 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2949797900,v1:127.0.0.1:6815/2949797900]", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/2", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_clean_epochs": { 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "min_last_epoch_clean": 0, 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": { 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "per_pool": [] 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "osd_epochs": [ 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 37 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 40 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_first_committed": 1, 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_last_committed": 42, 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "crushmap": { 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "devices": [ 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.039 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.0", 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.1", 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.2", 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "types": [ 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 0, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd" 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "name": "host" 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 2, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "name": "chassis" 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 3, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "name": "rack" 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 4, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "name": "row" 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 5, 2026-02-18T01:23:19.040 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pdu" 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 6, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pod" 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 7, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "name": "room" 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 8, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "name": "datacenter" 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 9, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "name": "zone" 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 10, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "name": "region" 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "name": "root" 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "buckets": [ 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "id": -1, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default", 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.041 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "id": -2, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default~ssd", 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080", 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:23:19.042 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080~ssd", 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.043 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "rules": [ 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "rule_id": 0, 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "rule_name": "replicated_rule", 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "type": 1, 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "steps": [ 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "op": "take", 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "item": -1, 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "item_name": "default" 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "op": "choose_firstn", 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "num": 0, 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "type": "osd" 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "op": "emit" 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "rule_id": 1, 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "rule_name": "test", 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "type": 3, 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "steps": [ 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "op": "set_chooseleaf_tries", 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "num": 5 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "op": "set_choose_tries", 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "num": 100 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "op": "take", 2026-02-18T01:23:19.044 INFO:tasks.workunit.client.0.trial080.stdout: "item": -1, 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "item_name": "default" 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "op": "choose_indep", 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "num": 0, 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "type": "osd" 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "op": "emit" 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stderr:report 1291923308 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "tunables": { 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_tries": 0, 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_fallback_tries": 0, 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "choose_total_tries": 50, 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_descend_once": 1, 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_vary_r": 1, 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_stable": 1, 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "msr_descents": 100, 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "msr_collision_tries": 100, 2026-02-18T01:23:19.045 INFO:tasks.workunit.client.0.trial080.stdout: "straw_calc_version": 1, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "allowed_bucket_algs": 54, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "profile": "jewel", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "optimal_tunables": 1, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "legacy_tunables": 0, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "minimum_required_version": "jewel", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables": 1, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables2": 1, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "has_v2_rules": 1, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables3": 1, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "has_v3_rules": 0, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "has_v4_buckets": 1, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables5": 1, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "has_v5_rules": 0, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "has_msr_rules": 0 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "choose_args": {} 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "fsmap": { 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "btime": "2026-02-18T01:21:58:031694+0000", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "default_fscid": -1, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "compat": { 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "compat": {}, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "ro_compat": {}, 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "incompat": { 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "feature_1": "base v0.20", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "feature_2": "client writeable ranges", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "feature_3": "default file layouts on dirs", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "feature_4": "dir inode in separate object", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "feature_5": "mds uses versioned encoding", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "feature_8": "no anchor table", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "feature_9": "file layout v2", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "feature_10": "snaprealm v2", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "feature_11": "minor log segments", 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: "feature_12": "quiesce subvolumes" 2026-02-18T01:23:19.046 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "feature_flags": { 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "enable_multiple": true, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "ever_enabled_multiple": true 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "standbys": [], 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "filesystems": [] 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_first_committed": 1, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_last_committed": 1, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "auth": { 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 5, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_secrets": 3 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 1, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_active": 1, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_unknown": 0, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_osd": 3, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "pool_sum": { 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 52200, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 101, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 1, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 303, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 101, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 101, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 101, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 101, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:23:19.047 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 18, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 18, 2026-02-18T01:23:19.048 INFO:tasks.workunit.client.0.trial080.stdout: "up": 3, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 3, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 0 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum": { 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 3, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 83924, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2148, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 25, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 81702, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314488876, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322036609024, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2199552, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 1540753, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 26416, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 83663056 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 0, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.049 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum_by_class": { 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "ssd": { 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 3, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 83924, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2148, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 25, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 81702, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314488876, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322036609024, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2199552, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 1540753, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 26416, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 83663056 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 0, 2026-02-18T01:23:19.050 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "pool_stats": [ 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": 1, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 1, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 52200, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 101, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 1, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 303, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 101, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 101, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 101, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 101, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:23:19.051 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 1241088, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 1241088, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 18, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 18, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "up": 3, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 3, 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 3 2026-02-18T01:23:19.052 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "osd_stats": [ 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 158913789962 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 42949672975 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 167503724554 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_state": [ 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "state": "active+undersized+degraded", 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "num": 1 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "pool_pg_unavailable_map": [ 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": "1", 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "pgs": [] 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_osd": [ 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2147483647, 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 1, 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:23:19.053 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 1, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 1, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 1, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 0, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": [ 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": {} 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "servicemap": { 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 3, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:23:06.491695+0000", 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "services": { 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "osd": { 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "daemons": { 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "summary": "", 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "0": { 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "start_epoch": 0, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "start_stamp": "0.000000", 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "gid": 0, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "metadata": {}, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "task_status": {} 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "2": { 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "start_epoch": 0, 2026-02-18T01:23:19.054 INFO:tasks.workunit.client.0.trial080.stdout: "start_stamp": "0.000000", 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "gid": 0, 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "metadata": {}, 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "task_status": {} 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_first_committed": 1, 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_last_committed": 41, 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "logm_first_committed": 1, 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "logm_last_committed": 231, 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "paxos": { 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 325, 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "last_pn": 0, 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: "accepted_pn": 0 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-18T01:23:19.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.0 2026-02-18T01:23:19.056 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:23:19.056 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:23:19.056 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:23:19.056 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:23:19.056 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:23:19.141 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:23:19.141 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 0 --op log --pgid 1.0 2026-02-18T01:23:19.141 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-18T01:23:19.141 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T01:23:19.141 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-18T01:23:19.141 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T01:23:19.141 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/0 2026-02-18T01:23:19.141 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/0 --op log --pgid 1.0 2026-02-18T01:23:19.327 INFO:tasks.workunit.client.0.trial080.stderr:PG '1.0' not found 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:23:19.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:23:19.416 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:23:19.416 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:23:19.416 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:23:19.416 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:23:19.416 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:23:19.416 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:23:19.416 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:23:19.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:23:19.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:23:19.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:23:19.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:23:19.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:23:19.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:23:19.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:23:19.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:23:19.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:23:19.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:23:19.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-18T01:23:19.418 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:23:19.418 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:23:19.418 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:23:19.418 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-18T01:23:19.419 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:23:19.419 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:23:19.420 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:23:19.420 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:23:19.440 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:19.431+0000 7fb37e73ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:23:19.442 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:19.431+0000 7fb37e73ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:23:19.443 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:19.435+0000 7fb37e73ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:23:19.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:23:19.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:23:19.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:23:19.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:23:19.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:23:19.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:23:19.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:23:19.633 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:23:19.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:23:19.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:23:19.852 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 37 up_thru 41 down_at 31 last_clean_interval [5,29) [v2:127.0.0.1:6800/890539449,v1:127.0.0.1:6801/890539449] [v2:127.0.0.1:6802/890539449,v1:127.0.0.1:6803/890539449] exists,up 93913594-6b7e-4e41-b650-1ee84f36d147 2026-02-18T01:23:19.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:23:19.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:23:19.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:23:19.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-18T01:23:19.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.2 2026-02-18T01:23:19.854 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:23:19.854 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:23:19.854 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:23:19.855 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:23:19.855 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:23:19.924 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:19.915+0000 7fb37e73ea40 -1 Falling back to public interface 2026-02-18T01:23:19.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:23:19.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 2 --op log --pgid 1.0 2026-02-18T01:23:19.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-18T01:23:19.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T01:23:19.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-18T01:23:19.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T01:23:19.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/2 2026-02-18T01:23:19.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/2 --op log --pgid 1.0 2026-02-18T01:23:20.148 INFO:tasks.workunit.client.0.trial080.stderr:PG '1.0' not found 2026-02-18T01:23:20.255 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-18T01:23:20.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-18T01:23:20.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:23:20.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:23:20.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T01:23:20.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:23:20.257 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-18T01:23:20.257 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:23:20.257 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:23:20.257 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:23:20.257 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:23:20.257 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-18T01:23:20.257 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-18T01:23:20.258 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:23:20.258 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:23:20.258 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:23:20.258 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:23:20.258 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:23:20.258 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:23:20.258 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:23:20.259 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:23:20.259 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:23:20.259 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:23:20.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:23:20.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:23:20.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:23:20.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:23:20.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:23:20.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:23:20.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:23:20.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:23:20.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:23:20.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:23:20.260 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-18T01:23:20.261 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:23:20.263 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T01:23:20.263 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:23:20.263 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-18T01:23:20.263 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T01:23:20.264 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:23:20.264 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:23:20.264 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:23:20.272 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:20.263+0000 7f16b8f64a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:23:20.273 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:20.263+0000 7f16b8f64a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:23:20.274 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:20.263+0000 7f16b8f64a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:23:20.472 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T01:23:20.472 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:23:20.472 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:23:20.473 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:23:20.473 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:23:20.473 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:23:20.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:23:20.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:23:20.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:23:20.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:23:20.661 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:20.651+0000 7f16b8f64a40 -1 Falling back to public interface 2026-02-18T01:23:20.684 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 39 up_thru 0 down_at 33 last_clean_interval [15,29) [v2:127.0.0.1:6810/2949797900,v1:127.0.0.1:6811/2949797900] [v2:127.0.0.1:6812/2949797900,v1:127.0.0.1:6813/2949797900] exists,up 0035cdac-f15f-47cf-b751-9feed4d3ddbe 2026-02-18T01:23:20.686 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:23:20.686 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:23:20.686 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:23:20.686 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:336: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 1 --op log --pgid 1.0 2026-02-18T01:23:20.686 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-18T01:23:20.686 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T01:23:20.686 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T01:23:20.686 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T01:23:20.686 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-18T01:23:20.686 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op log --pgid 1.0 2026-02-18T01:23:20.741 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:20.731+0000 7fb37e73ea40 -1 osd.0 42 log_to_monitors true 2026-02-18T01:23:20.945 INFO:tasks.workunit.client.0.trial080.stderr:PG '1.0' not found 2026-02-18T01:23:21.059 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-18T01:23:21.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-18T01:23:21.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: wait_for_clean 2026-02-18T01:23:21.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:23:21.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:23:21.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:23:21.060 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-18T01:23:21.061 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:23:21.061 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:23:21.061 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:23:21.061 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:23:21.061 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:23:21.128 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-18T01:23:21.128 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:23:21.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:23:21.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:23:21.129 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:23:21.129 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:23:21.348 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:23:21.348 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:23:21.348 INFO:tasks.workunit.client.0.trial080.stderr:2' 2026-02-18T01:23:21.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:23:21.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:23:21.349 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:23:21.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528323 2026-02-18T01:23:21.432 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528323 2026-02-18T01:23:21.432 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-193273528323' 2026-02-18T01:23:21.432 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:23:21.432 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:23:21.489 INFO:tasks.workunit.client.0.trial080.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-18T01:23:21.492 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-18T01:23:21.492 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-18T01:23:21.492 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-18T01:23:21.492 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:23:21.492 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:23:21.541 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:21.531+0000 7f16b8f64a40 -1 osd.2 42 log_to_monitors true 2026-02-18T01:23:26.574 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397507 2026-02-18T01:23:26.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397507 2026-02-18T01:23:26.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-193273528323 2-210453397507' 2026-02-18T01:23:26.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:23:26.575 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-193273528323 2026-02-18T01:23:26.575 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:23:26.576 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:23:26.577 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-193273528323 2026-02-18T01:23:26.577 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:23:26.578 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528323 2026-02-18T01:23:26.579 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 193273528323 2026-02-18T01:23:26.579 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 193273528323' 2026-02-18T01:23:26.579 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:23:26.796 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528324 -lt 193273528323 2026-02-18T01:23:26.796 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:23:26.797 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-210453397507 2026-02-18T01:23:26.797 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:23:26.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:23:26.798 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-210453397507 2026-02-18T01:23:26.799 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:23:26.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=210453397507 2026-02-18T01:23:26.800 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 210453397507 2026-02-18T01:23:26.801 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 210453397507' 2026-02-18T01:23:26.801 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:23:27.023 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 210453397507 2026-02-18T01:23:27.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:23:28.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:23:28.026 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:23:28.244 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 210453397507 2026-02-18T01:23:28.244 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:23:29.246 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T01:23:29.247 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:23:29.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 210453397508 -lt 210453397507 2026-02-18T01:23:29.467 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:23:29.467 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:29.467 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:29.753 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:23:29.753 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:23:29.753 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:23:29.753 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:23:29.753 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:23:29.753 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:23:29.754 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:23:29.754 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:23:29.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:23:29.963 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:23:29.964 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:29.964 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:30.251 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:23:30.251 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-18T01:23:30.251 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-18T01:23:30.251 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-18T01:23:30.251 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:23:30.251 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-18T01:23:30.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:23:30.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:23:30.351 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:23:30.351 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:23:30.351 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:23:30.351 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:23:30.352 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:23:30.352 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:23:30.565 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:23:30.566 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:23:30.566 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:30.566 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:30.859 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:23:30.860 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:23:30.860 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:23:30.860 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:23:30.860 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:23:30.860 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:23:30.860 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:23:30.861 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:23:30.861 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:23:31.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:23:31.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:23:31.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-18T01:23:31.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:23:31.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-18T01:23:31.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:23:31.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:23:31.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:23:31.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:23:31.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:23:31.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:23:31.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:23:31.338 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:23:31.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:23:31.544 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:23:31.544 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:31.544 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:31.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:23:31.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:23:31.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:23:31.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:23:31.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:23:31.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:23:31.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:23:31.822 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:23:31.822 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:23:32.098 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:23:32.098 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:23:32.098 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-18T01:23:32.098 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:23:32.098 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-18T01:23:32.498 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:23:32.498 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:23:32.499 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:23:32.499 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:23:32.499 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:23:32.499 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:23:32.499 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:23:32.499 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:23:32.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:23:32.712 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:23:32.712 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:32.712 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:33.006 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:23:33.006 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:23:33.007 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:23:33.007 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:23:33.007 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:23:33.007 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:23:33.007 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:23:33.007 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:23:33.007 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:23:33.289 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:23:33.290 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:23:33.290 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-18T01:23:33.290 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:23:33.290 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-18T01:23:34.090 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:23:34.090 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:23:34.091 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:23:34.092 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:23:34.092 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:23:34.092 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:23:34.092 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:23:34.092 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:23:34.302 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:23:34.303 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:23:34.303 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:34.303 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:34.585 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:23:34.586 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:23:34.586 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:23:34.586 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:23:34.586 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:23:34.586 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:23:34.587 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:23:34.587 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:23:34.587 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:23:34.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:23:34.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:23:34.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-18T01:23:34.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:23:34.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-18T01:23:36.463 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:23:36.463 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:23:36.464 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:23:36.464 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:23:36.464 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:23:36.464 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:23:36.465 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:23:36.465 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:23:36.672 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:23:36.673 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:23:36.673 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:36.673 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:36.952 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:23:36.952 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:23:36.953 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:23:36.953 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:23:36.953 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:23:36.953 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:23:36.953 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:23:36.953 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:23:36.953 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:23:37.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:23:37.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:23:37.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-18T01:23:37.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:23:37.241 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-18T01:23:40.442 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:23:40.442 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:23:40.443 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:23:40.443 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:23:40.444 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:23:40.444 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:23:40.444 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:23:40.444 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:23:40.651 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:23:40.652 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:23:40.653 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:40.653 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:40.933 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:23:40.934 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:23:40.934 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:23:40.934 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:23:40.934 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:23:40.934 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:23:40.934 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:23:40.934 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:23:40.934 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:23:41.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:23:41.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:23:41.216 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-18T01:23:41.216 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:23:41.216 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-18T01:23:47.617 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:23:47.617 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:23:47.618 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:23:47.618 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:23:47.618 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:23:47.618 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:23:47.618 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:23:47.618 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:23:47.837 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:23:47.837 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:23:47.838 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:47.838 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:48.116 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:23:48.116 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:23:48.116 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:23:48.116 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:23:48.116 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:23:48.117 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:23:48.117 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:23:48.117 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:23:48.117 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:23:48.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:23:48.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:23:48.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-18T01:23:48.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T01:23:48.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-18T01:23:55.706 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T01:23:55.706 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:23:55.707 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:23:55.707 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:23:55.707 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:23:55.707 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:23:55.707 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:23:55.708 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:23:55.918 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T01:23:55.919 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:23:55.919 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:23:55.919 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:23:56.200 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-18T01:23:56.200 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T01:23:56.200 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T01:23:56.200 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T01:23:56.201 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T01:23:56.201 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T01:23:56.201 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T01:23:56.201 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T01:23:56.201 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T01:23:56.477 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T01:23:56.477 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T01:23:56.477 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-18T01:23:56.477 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-18T01:23:56.751 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:23:56.751 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_fingerprint": "a35ff708-712e-4af3-8f8e-d33b22bbe76a", 2026-02-18T01:23:56.751 INFO:tasks.workunit.client.0.trial080.stdout: "version": "20.2.0-670-gadc19233", 2026-02-18T01:23:56.751 INFO:tasks.workunit.client.0.trial080.stdout: "commit": "adc1923395f2bcd6ae89b5d331d278364d1848ed", 2026-02-18T01:23:56.751 INFO:tasks.workunit.client.0.trial080.stdout: "timestamp": "2026-02-18T01:23:56.744946+0000", 2026-02-18T01:23:56.752 INFO:tasks.workunit.client.0.trial080.stdout: "tag": "", 2026-02-18T01:23:56.752 INFO:tasks.workunit.client.0.trial080.stdout: "health": { 2026-02-18T01:23:56.752 INFO:tasks.workunit.client.0.trial080.stdout: "status": "HEALTH_WARN", 2026-02-18T01:23:56.752 INFO:tasks.workunit.client.0.trial080.stdout: "checks": { 2026-02-18T01:23:56.752 INFO:tasks.workunit.client.0.trial080.stdout: "OSDMAP_FLAGS": { 2026-02-18T01:23:56.752 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:23:56.752 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:23:56.752 INFO:tasks.workunit.client.0.trial080.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-18T01:23:56.752 INFO:tasks.workunit.client.0.trial080.stdout: "count": 17 2026-02-18T01:23:56.752 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.753 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [], 2026-02-18T01:23:56.753 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:23:56.753 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.753 INFO:tasks.workunit.client.0.trial080.stdout: "OSD_DOWN": { 2026-02-18T01:23:56.753 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:23:56.753 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:23:56.753 INFO:tasks.workunit.client.0.trial080.stdout: "message": "1 osds down", 2026-02-18T01:23:56.753 INFO:tasks.workunit.client.0.trial080.stdout: "count": 1 2026-02-18T01:23:56.753 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.753 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:23:56.754 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.754 INFO:tasks.workunit.client.0.trial080.stdout: "message": "osd.1 (root=default,host=trial080) is down" 2026-02-18T01:23:56.754 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.754 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.754 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:23:56.754 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.754 INFO:tasks.workunit.client.0.trial080.stdout: "PG_DEGRADED": { 2026-02-18T01:23:56.754 INFO:tasks.workunit.client.0.trial080.stdout: "severity": "HEALTH_WARN", 2026-02-18T01:23:56.754 INFO:tasks.workunit.client.0.trial080.stdout: "summary": { 2026-02-18T01:23:56.754 INFO:tasks.workunit.client.0.trial080.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-18T01:23:56.755 INFO:tasks.workunit.client.0.trial080.stdout: "count": 1 2026-02-18T01:23:56.755 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.755 INFO:tasks.workunit.client.0.trial080.stdout: "detail": [ 2026-02-18T01:23:56.755 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.755 INFO:tasks.workunit.client.0.trial080.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-18T01:23:56.755 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.755 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.755 INFO:tasks.workunit.client.0.trial080.stdout: "muted": false 2026-02-18T01:23:56.755 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.755 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.755 INFO:tasks.workunit.client.0.trial080.stdout: "mutes": [] 2026-02-18T01:23:56.756 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.756 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_first_committed": 1, 2026-02-18T01:23:56.756 INFO:tasks.workunit.client.0.trial080.stdout: "monmap_last_committed": 1, 2026-02-18T01:23:56.756 INFO:tasks.workunit.client.0.trial080.stdout: "monmap": { 2026-02-18T01:23:56.756 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:23:56.756 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:23:56.756 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:21:57.951530Z", 2026-02-18T01:23:56.756 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:21:57.951530Z", 2026-02-18T01:23:56.756 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release": 20, 2026-02-18T01:23:56.757 INFO:tasks.workunit.client.0.trial080.stdout: "min_mon_release_name": "tentacle", 2026-02-18T01:23:56.757 INFO:tasks.workunit.client.0.trial080.stdout: "election_strategy": 1, 2026-02-18T01:23:56.757 INFO:tasks.workunit.client.0.trial080.stdout: "disallowed_leaders": "", 2026-02-18T01:23:56.757 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": false, 2026-02-18T01:23:56.757 INFO:tasks.workunit.client.0.trial080.stdout: "tiebreaker_mon": "", 2026-02-18T01:23:56.757 INFO:tasks.workunit.client.0.trial080.stdout: "removed_ranks": "", 2026-02-18T01:23:56.757 INFO:tasks.workunit.client.0.trial080.stdout: "features": { 2026-02-18T01:23:56.757 INFO:tasks.workunit.client.0.trial080.stdout: "persistent": [ 2026-02-18T01:23:56.757 INFO:tasks.workunit.client.0.trial080.stdout: "kraken", 2026-02-18T01:23:56.757 INFO:tasks.workunit.client.0.trial080.stdout: "luminous", 2026-02-18T01:23:56.757 INFO:tasks.workunit.client.0.trial080.stdout: "mimic", 2026-02-18T01:23:56.758 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap-prune", 2026-02-18T01:23:56.758 INFO:tasks.workunit.client.0.trial080.stdout: "nautilus", 2026-02-18T01:23:56.758 INFO:tasks.workunit.client.0.trial080.stdout: "octopus", 2026-02-18T01:23:56.758 INFO:tasks.workunit.client.0.trial080.stdout: "pacific", 2026-02-18T01:23:56.758 INFO:tasks.workunit.client.0.trial080.stdout: "elector-pinging", 2026-02-18T01:23:56.758 INFO:tasks.workunit.client.0.trial080.stdout: "quincy", 2026-02-18T01:23:56.758 INFO:tasks.workunit.client.0.trial080.stdout: "reef", 2026-02-18T01:23:56.758 INFO:tasks.workunit.client.0.trial080.stdout: "squid", 2026-02-18T01:23:56.758 INFO:tasks.workunit.client.0.trial080.stdout: "tentacle", 2026-02-18T01:23:56.758 INFO:tasks.workunit.client.0.trial080.stdout: "nvmeof_beacon_diff" 2026-02-18T01:23:56.758 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.759 INFO:tasks.workunit.client.0.trial080.stdout: "optional": [] 2026-02-18T01:23:56.759 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.759 INFO:tasks.workunit.client.0.trial080.stdout: "mons": [ 2026-02-18T01:23:56.759 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.759 INFO:tasks.workunit.client.0.trial080.stdout: "rank": 0, 2026-02-18T01:23:56.759 INFO:tasks.workunit.client.0.trial080.stdout: "name": "a", 2026-02-18T01:23:56.759 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:23:56.759 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.759 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.759 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.760 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115", 2026-02-18T01:23:56.760 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 0 2026-02-18T01:23:56.760 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.760 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.760 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.760 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:7115/0", 2026-02-18T01:23:56.760 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-18T01:23:56.760 INFO:tasks.workunit.client.0.trial080.stdout: "priority": 0, 2026-02-18T01:23:56.760 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 0, 2026-02-18T01:23:56.760 INFO:tasks.workunit.client.0.trial080.stdout: "crush_location": "{}" 2026-02-18T01:23:56.760 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.761 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.761 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.761 INFO:tasks.workunit.client.0.trial080.stdout: "quorum": [ 2026-02-18T01:23:56.761 INFO:tasks.workunit.client.0.trial080.stdout: 0 2026-02-18T01:23:56.761 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.761 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap": { 2026-02-18T01:23:56.761 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 50, 2026-02-18T01:23:56.761 INFO:tasks.workunit.client.0.trial080.stdout: "fsid": "7426e8e1-23b3-468d-99f4-892559a19a37", 2026-02-18T01:23:56.761 INFO:tasks.workunit.client.0.trial080.stdout: "created": "2026-02-18T01:21:58.031906+0000", 2026-02-18T01:23:56.761 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:23:21.918853+0000", 2026-02-18T01:23:56.761 INFO:tasks.workunit.client.0.trial080.stdout: "last_up_change": "2026-02-18T01:23:21.816419+0000", 2026-02-18T01:23:56.762 INFO:tasks.workunit.client.0.trial080.stdout: "last_in_change": "2026-02-18T01:22:44.164432+0000", 2026-02-18T01:23:56.762 INFO:tasks.workunit.client.0.trial080.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-18T01:23:56.762 INFO:tasks.workunit.client.0.trial080.stdout: "flags_num": 5800384, 2026-02-18T01:23:56.762 INFO:tasks.workunit.client.0.trial080.stdout: "flags_set": [ 2026-02-18T01:23:56.762 INFO:tasks.workunit.client.0.trial080.stdout: "nodown", 2026-02-18T01:23:56.762 INFO:tasks.workunit.client.0.trial080.stdout: "noin", 2026-02-18T01:23:56.762 INFO:tasks.workunit.client.0.trial080.stdout: "noout", 2026-02-18T01:23:56.762 INFO:tasks.workunit.client.0.trial080.stdout: "pglog_hardlimit", 2026-02-18T01:23:56.762 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snapdirs", 2026-02-18T01:23:56.762 INFO:tasks.workunit.client.0.trial080.stdout: "recovery_deletes", 2026-02-18T01:23:56.763 INFO:tasks.workunit.client.0.trial080.stdout: "sortbitwise" 2026-02-18T01:23:56.763 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.763 INFO:tasks.workunit.client.0.trial080.stdout: "crush_version": 12, 2026-02-18T01:23:56.763 INFO:tasks.workunit.client.0.trial080.stdout: "full_ratio": 0.99000000953674316, 2026-02-18T01:23:56.763 INFO:tasks.workunit.client.0.trial080.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-18T01:23:56.763 INFO:tasks.workunit.client.0.trial080.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-18T01:23:56.763 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_snapshot": "", 2026-02-18T01:23:56.763 INFO:tasks.workunit.client.0.trial080.stdout: "pool_max": 1, 2026-02-18T01:23:56.763 INFO:tasks.workunit.client.0.trial080.stdout: "max_osd": 3, 2026-02-18T01:23:56.763 INFO:tasks.workunit.client.0.trial080.stdout: "require_min_compat_client": "luminous", 2026-02-18T01:23:56.764 INFO:tasks.workunit.client.0.trial080.stdout: "min_compat_client": "jewel", 2026-02-18T01:23:56.764 INFO:tasks.workunit.client.0.trial080.stdout: "require_osd_release": "tentacle", 2026-02-18T01:23:56.764 INFO:tasks.workunit.client.0.trial080.stdout: "allow_crimson": false, 2026-02-18T01:23:56.764 INFO:tasks.workunit.client.0.trial080.stdout: "pools": [ 2026-02-18T01:23:56.764 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.764 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:23:56.764 INFO:tasks.workunit.client.0.trial080.stdout: "pool_name": "test", 2026-02-18T01:23:56.764 INFO:tasks.workunit.client.0.trial080.stdout: "create_time": "2026-02-18T01:22:10.201498+0000", 2026-02-18T01:23:56.764 INFO:tasks.workunit.client.0.trial080.stdout: "flags": 16389, 2026-02-18T01:23:56.764 INFO:tasks.workunit.client.0.trial080.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-18T01:23:56.764 INFO:tasks.workunit.client.0.trial080.stdout: "type": 3, 2026-02-18T01:23:56.765 INFO:tasks.workunit.client.0.trial080.stdout: "size": 3, 2026-02-18T01:23:56.765 INFO:tasks.workunit.client.0.trial080.stdout: "min_size": 2, 2026-02-18T01:23:56.765 INFO:tasks.workunit.client.0.trial080.stdout: "crush_rule": 1, 2026-02-18T01:23:56.765 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_count": 0, 2026-02-18T01:23:56.765 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_target": 0, 2026-02-18T01:23:56.765 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_barrier": 0, 2026-02-18T01:23:56.765 INFO:tasks.workunit.client.0.trial080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-18T01:23:56.765 INFO:tasks.workunit.client.0.trial080.stdout: "is_stretch_pool": false, 2026-02-18T01:23:56.765 INFO:tasks.workunit.client.0.trial080.stdout: "object_hash": 2, 2026-02-18T01:23:56.765 INFO:tasks.workunit.client.0.trial080.stdout: "pg_autoscale_mode": "off", 2026-02-18T01:23:56.765 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num": 1, 2026-02-18T01:23:56.766 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num": 1, 2026-02-18T01:23:56.766 INFO:tasks.workunit.client.0.trial080.stdout: "pg_placement_num_target": 1, 2026-02-18T01:23:56.766 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_target": 1, 2026-02-18T01:23:56.766 INFO:tasks.workunit.client.0.trial080.stdout: "pg_num_pending": 1, 2026-02-18T01:23:56.766 INFO:tasks.workunit.client.0.trial080.stdout: "last_pg_merge_meta": { 2026-02-18T01:23:56.766 INFO:tasks.workunit.client.0.trial080.stdout: "source_pgid": "0.0", 2026-02-18T01:23:56.766 INFO:tasks.workunit.client.0.trial080.stdout: "ready_epoch": 0, 2026-02-18T01:23:56.766 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_started": 0, 2026-02-18T01:23:56.766 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": 0, 2026-02-18T01:23:56.766 INFO:tasks.workunit.client.0.trial080.stdout: "source_version": "0'0", 2026-02-18T01:23:56.766 INFO:tasks.workunit.client.0.trial080.stdout: "target_version": "0'0" 2026-02-18T01:23:56.767 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.767 INFO:tasks.workunit.client.0.trial080.stdout: "last_change": "30", 2026-02-18T01:23:56.767 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend": "0", 2026-02-18T01:23:56.767 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-18T01:23:56.767 INFO:tasks.workunit.client.0.trial080.stdout: "last_force_op_resend_preluminous": "0", 2026-02-18T01:23:56.767 INFO:tasks.workunit.client.0.trial080.stdout: "auid": 0, 2026-02-18T01:23:56.767 INFO:tasks.workunit.client.0.trial080.stdout: "snap_mode": "pool", 2026-02-18T01:23:56.767 INFO:tasks.workunit.client.0.trial080.stdout: "snap_seq": 1, 2026-02-18T01:23:56.767 INFO:tasks.workunit.client.0.trial080.stdout: "snap_epoch": 30, 2026-02-18T01:23:56.767 INFO:tasks.workunit.client.0.trial080.stdout: "pool_snaps": [ 2026-02-18T01:23:56.768 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.768 INFO:tasks.workunit.client.0.trial080.stdout: "snapid": 1, 2026-02-18T01:23:56.768 INFO:tasks.workunit.client.0.trial080.stdout: "stamp": "2026-02-18T01:22:28.312865+0000", 2026-02-18T01:23:56.768 INFO:tasks.workunit.client.0.trial080.stdout: "name": "snap1" 2026-02-18T01:23:56.768 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.768 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.768 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps": "[]", 2026-02-18T01:23:56.768 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_bytes": 0, 2026-02-18T01:23:56.768 INFO:tasks.workunit.client.0.trial080.stdout: "quota_max_objects": 0, 2026-02-18T01:23:56.768 INFO:tasks.workunit.client.0.trial080.stdout: "tiers": [], 2026-02-18T01:23:56.768 INFO:tasks.workunit.client.0.trial080.stdout: "tier_of": -1, 2026-02-18T01:23:56.768 INFO:tasks.workunit.client.0.trial080.stdout: "read_tier": -1, 2026-02-18T01:23:56.769 INFO:tasks.workunit.client.0.trial080.stdout: "write_tier": -1, 2026-02-18T01:23:56.769 INFO:tasks.workunit.client.0.trial080.stdout: "cache_mode": "none", 2026-02-18T01:23:56.769 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_bytes": 0, 2026-02-18T01:23:56.769 INFO:tasks.workunit.client.0.trial080.stdout: "target_max_objects": 0, 2026-02-18T01:23:56.769 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-18T01:23:56.769 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-18T01:23:56.769 INFO:tasks.workunit.client.0.trial080.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-18T01:23:56.769 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_flush_age": 0, 2026-02-18T01:23:56.769 INFO:tasks.workunit.client.0.trial080.stdout: "cache_min_evict_age": 0, 2026-02-18T01:23:56.769 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profile": "myprofile", 2026-02-18T01:23:56.769 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_params": { 2026-02-18T01:23:56.770 INFO:tasks.workunit.client.0.trial080.stdout: "type": "none" 2026-02-18T01:23:56.770 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.770 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_period": 0, 2026-02-18T01:23:56.770 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_count": 0, 2026-02-18T01:23:56.770 INFO:tasks.workunit.client.0.trial080.stdout: "use_gmt_hitset": true, 2026-02-18T01:23:56.770 INFO:tasks.workunit.client.0.trial080.stdout: "min_read_recency_for_promote": 0, 2026-02-18T01:23:56.770 INFO:tasks.workunit.client.0.trial080.stdout: "min_write_recency_for_promote": 0, 2026-02-18T01:23:56.770 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_grade_decay_rate": 0, 2026-02-18T01:23:56.770 INFO:tasks.workunit.client.0.trial080.stdout: "hit_set_search_last_n": 0, 2026-02-18T01:23:56.770 INFO:tasks.workunit.client.0.trial080.stdout: "grade_table": [], 2026-02-18T01:23:56.770 INFO:tasks.workunit.client.0.trial080.stdout: "stripe_width": 8192, 2026-02-18T01:23:56.771 INFO:tasks.workunit.client.0.trial080.stdout: "expected_num_objects": 0, 2026-02-18T01:23:56.771 INFO:tasks.workunit.client.0.trial080.stdout: "fast_read": false, 2026-02-18T01:23:56.771 INFO:tasks.workunit.client.0.trial080.stdout: "nonprimary_shards": "{}", 2026-02-18T01:23:56.771 INFO:tasks.workunit.client.0.trial080.stdout: "options": {}, 2026-02-18T01:23:56.771 INFO:tasks.workunit.client.0.trial080.stdout: "application_metadata": {} 2026-02-18T01:23:56.771 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.771 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.771 INFO:tasks.workunit.client.0.trial080.stdout: "osds": [ 2026-02-18T01:23:56.771 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.771 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:23:56.772 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "93913594-6b7e-4e41-b650-1ee84f36d147", 2026-02-18T01:23:56.772 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:23:56.772 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:23:56.772 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:23:56.772 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:23:56.772 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 37, 2026-02-18T01:23:56.772 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 42, 2026-02-18T01:23:56.772 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 45, 2026-02-18T01:23:56.772 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 49, 2026-02-18T01:23:56.772 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 44, 2026-02-18T01:23:56.772 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:23:56.772 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:23:56.773 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.773 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.773 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.773 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6800", 2026-02-18T01:23:56.773 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2664791185 2026-02-18T01:23:56.773 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.773 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.773 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:56.773 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6801", 2026-02-18T01:23:56.773 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2664791185 2026-02-18T01:23:56.773 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.774 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.774 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.774 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:23:56.774 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.774 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.774 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.774 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6802", 2026-02-18T01:23:56.774 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2664791185 2026-02-18T01:23:56.774 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.774 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.775 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:56.775 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6803", 2026-02-18T01:23:56.775 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2664791185 2026-02-18T01:23:56.775 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.775 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.775 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.775 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:23:56.775 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.775 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.775 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.775 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6806", 2026-02-18T01:23:56.776 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2664791185 2026-02-18T01:23:56.776 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.776 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.776 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:56.776 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6807", 2026-02-18T01:23:56.776 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2664791185 2026-02-18T01:23:56.776 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.776 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.776 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.776 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:23:56.776 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.777 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.777 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.777 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6804", 2026-02-18T01:23:56.777 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2664791185 2026-02-18T01:23:56.777 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.777 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.777 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:56.777 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6805", 2026-02-18T01:23:56.777 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 2664791185 2026-02-18T01:23:56.777 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.778 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.778 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.778 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6801/2664791185", 2026-02-18T01:23:56.778 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6803/2664791185", 2026-02-18T01:23:56.778 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2664791185", 2026-02-18T01:23:56.778 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2664791185", 2026-02-18T01:23:56.778 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:23:56.778 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:23:56.778 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:23:56.778 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.778 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.779 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.779 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:23:56.779 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "06b951d7-efc6-4811-9cbd-30f3073451e6", 2026-02-18T01:23:56.779 INFO:tasks.workunit.client.0.trial080.stdout: "up": 0, 2026-02-18T01:23:56.779 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:23:56.779 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:23:56.779 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:23:56.779 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 0, 2026-02-18T01:23:56.779 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 0, 2026-02-18T01:23:56.779 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 10, 2026-02-18T01:23:56.779 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 25, 2026-02-18T01:23:56.780 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 32, 2026-02-18T01:23:56.780 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:23:56.780 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:23:56.780 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.780 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.780 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.780 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:23:56.780 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:56.780 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.780 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.780 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:56.781 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:23:56.781 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:56.781 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.781 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.781 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.781 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:23:56.781 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.781 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.781 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.781 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:23:56.781 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:56.782 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.782 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.782 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:56.782 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:23:56.782 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:56.782 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.782 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.782 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.782 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:23:56.782 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.782 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.783 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.783 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:23:56.783 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:56.783 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.783 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.783 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:56.783 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:23:56.783 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:56.783 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.783 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.783 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.784 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:23:56.784 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.784 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.784 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.784 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:23:56.784 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:56.784 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.784 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.784 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:56.784 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:23:56.784 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3526270237 2026-02-18T01:23:56.785 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.785 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.785 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.785 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/3526270237", 2026-02-18T01:23:56.785 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/3526270237", 2026-02-18T01:23:56.785 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3526270237", 2026-02-18T01:23:56.785 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3526270237", 2026-02-18T01:23:56.785 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:23:56.785 INFO:tasks.workunit.client.0.trial080.stdout: "exists" 2026-02-18T01:23:56.785 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.786 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.786 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.786 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:23:56.786 INFO:tasks.workunit.client.0.trial080.stdout: "uuid": "0035cdac-f15f-47cf-b751-9feed4d3ddbe", 2026-02-18T01:23:56.786 INFO:tasks.workunit.client.0.trial080.stdout: "up": 1, 2026-02-18T01:23:56.786 INFO:tasks.workunit.client.0.trial080.stdout: "in": 1, 2026-02-18T01:23:56.786 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 1, 2026-02-18T01:23:56.786 INFO:tasks.workunit.client.0.trial080.stdout: "primary_affinity": 1, 2026-02-18T01:23:56.786 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_begin": 39, 2026-02-18T01:23:56.786 INFO:tasks.workunit.client.0.trial080.stdout: "last_clean_end": 42, 2026-02-18T01:23:56.786 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 49, 2026-02-18T01:23:56.786 INFO:tasks.workunit.client.0.trial080.stdout: "up_thru": 0, 2026-02-18T01:23:56.787 INFO:tasks.workunit.client.0.trial080.stdout: "down_at": 48, 2026-02-18T01:23:56.787 INFO:tasks.workunit.client.0.trial080.stdout: "lost_at": 0, 2026-02-18T01:23:56.787 INFO:tasks.workunit.client.0.trial080.stdout: "public_addrs": { 2026-02-18T01:23:56.787 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.787 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.787 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.787 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6810", 2026-02-18T01:23:56.787 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3589176353 2026-02-18T01:23:56.787 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.787 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.787 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:56.788 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6811", 2026-02-18T01:23:56.788 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3589176353 2026-02-18T01:23:56.788 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.788 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.788 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.788 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addrs": { 2026-02-18T01:23:56.788 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.788 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.788 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.788 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6812", 2026-02-18T01:23:56.788 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3589176353 2026-02-18T01:23:56.788 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.789 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.789 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:56.789 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6813", 2026-02-18T01:23:56.789 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3589176353 2026-02-18T01:23:56.789 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.789 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.789 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.789 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addrs": { 2026-02-18T01:23:56.789 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.789 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.789 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.789 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6816", 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3589176353 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6817", 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3589176353 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addrs": { 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: "addrvec": [ 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v2", 2026-02-18T01:23:56.790 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6814", 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3589176353 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: "type": "v1", 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "127.0.0.1:6815", 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: "nonce": 3589176353 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: "public_addr": "127.0.0.1:6811/3589176353", 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: "cluster_addr": "127.0.0.1:6813/3589176353", 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3589176353", 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3589176353", 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: "state": [ 2026-02-18T01:23:56.791 INFO:tasks.workunit.client.0.trial080.stdout: "exists", 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: "up" 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: "osd_xinfo": [ 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:23:20.860403+0000", 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:22:01.475012+0000", 2026-02-18T01:23:56.792 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:22:39.228860+0000", 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:22:05.064693+0000", 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.793 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "down_stamp": "2026-02-18T01:23:21.715782+0000", 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_probability": 0, 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "laggy_interval": 0, 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "features": 4544132024016699391, 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "old_weight": 0, 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "last_purged_snaps_scrub": "2026-02-18T01:22:09.144634+0000", 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "dead_epoch": 0 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap": [], 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_items": [], 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "pg_upmap_primaries": [], 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "pg_temp": [], 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "primary_temp": [], 2026-02-18T01:23:56.794 INFO:tasks.workunit.client.0.trial080.stdout: "blocklist": {}, 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "range_blocklist": {}, 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "erasure_code_profiles": { 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "default": { 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "k": "2", 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "m": "2", 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "plugin": "isa", 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "technique": "reed_sol_van" 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "myprofile": { 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "crush-device-class": "", 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "crush-failure-domain": "osd", 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "crush-num-failure-domains": "0", 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "crush-osds-per-failure-domain": "0", 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "crush-root": "default", 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "k": "2", 2026-02-18T01:23:56.795 INFO:tasks.workunit.client.0.trial080.stdout: "m": "1", 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "plugin": "isa", 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "technique": "reed_sol_van" 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "removed_snaps_queue": [], 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "new_removed_snaps": [], 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "new_purged_snaps": [], 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "crush_node_flags": {}, 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "device_class_flags": {}, 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode": { 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_enabled": false, 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_bucket_count": 0, 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "degraded_stretch_mode": 0, 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "recovering_stretch_mode": 0, 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: "stretch_mode_bucket": 0 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.796 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "osd_metadata": [ 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6802/2664791185,v1:127.0.0.1:6803/2664791185]", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:21:59.017235Z", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:23:56.797 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6800/2664791185,v1:127.0.0.1:6801/2664791185]", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2664791185,v1:127.0.0.1:6807/2664791185]", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2664791185,v1:127.0.0.1:6805/2664791185]", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/0", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/3526270237,v1:127.0.0.1:6813/3526270237]", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:23:56.798 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:22:02.654273Z", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/3526270237,v1:127.0.0.1:6811/3526270237]", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3526270237,v1:127.0.0.1:6817/3526270237]", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3526270237,v1:127.0.0.1:6815/3526270237]", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/1", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:23:56.799 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "arch": "x86_64", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "back_addr": "[v2:127.0.0.1:6812/3589176353,v1:127.0.0.1:6813/3589176353]", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "back_iface": "", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs": "1", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_db": "0", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluefs_single_shared_device": "1", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_allocator": "hybrid", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "bluestore_write_mode": "classic", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_release": "tentacle", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "created_at": "2026-02-18T01:22:06.773268Z", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "default_device_class": "ssd", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD87E5", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T01:23:56.800 INFO:tasks.workunit.client.0.trial080.stdout: "devices": "nvme0n1", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "distro": "ubuntu", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "distro_version": "22.04", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "front_addr": "[v2:127.0.0.1:6810/3589176353,v1:127.0.0.1:6811/3589176353]", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "front_iface": "", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3589176353,v1:127.0.0.1:6817/3589176353]", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3589176353,v1:127.0.0.1:6815/3589176353]", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "hostname": "trial080", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "journal_rotational": "0", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "mem_swap_kb": "8388604", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "mem_total_kb": "130961700", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_node": "0", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "objectstore_numa_nodes": "0", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "os": "Linux", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "osd_data": "td/divergent-priors/2", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "osd_objectstore": "bluestore", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "osdspec_affinity": "", 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "rotational": "0" 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_clean_epochs": { 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "min_last_epoch_clean": 26, 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "last_epoch_clean": { 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "per_pool": [ 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": 1, 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "floor": 26 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "osd_epochs": [ 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 46 2026-02-18T01:23:56.801 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 50 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_first_committed": 1, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "osdmap_last_committed": 50, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "crushmap": { 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "devices": [ 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.0", 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.1", 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd.2", 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "class": "ssd" 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "types": [ 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 0, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "name": "osd" 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "name": "host" 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 2, 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: "name": "chassis" 2026-02-18T01:23:56.802 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 3, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "name": "rack" 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 4, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "name": "row" 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 5, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pdu" 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 6, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "name": "pod" 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 7, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "name": "room" 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 8, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "name": "datacenter" 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 9, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "name": "zone" 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 10, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "name": "region" 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "name": "root" 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: "buckets": [ 2026-02-18T01:23:56.803 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "id": -1, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default", 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "id": -2, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "name": "default~ssd", 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 11, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "root", 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "id": -3, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080", 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:23:56.804 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "id": -4, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "name": "trial080~ssd", 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "type_id": 1, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "type_name": "host", 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 19206, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "alg": "straw2", 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "hash": "rjenkins1", 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "items": [ 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "id": 0, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 0 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "id": 1, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 1 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.805 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "id": 2, 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "weight": 6402, 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "pos": 2 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "rules": [ 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "rule_id": 0, 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "rule_name": "replicated_rule", 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "type": 1, 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "steps": [ 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "op": "take", 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "item": -1, 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "item_name": "default" 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "op": "choose_firstn", 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "num": 0, 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "type": "osd" 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "op": "emit" 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "rule_id": 1, 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "rule_name": "test", 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "type": 3, 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "steps": [ 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "op": "set_chooseleaf_tries", 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "num": 5 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.806 INFO:tasks.workunit.client.0.trial080.stdout: "op": "set_choose_tries", 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "num": 100 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "op": "take", 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "item": -1, 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "item_name": "default" 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "op": "choose_indep", 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "num": 0, 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "type": "osd" 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stderr:report 2198543629 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "op": "emit" 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: ] 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "tunables": { 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_tries": 0, 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "choose_local_fallback_tries": 0, 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "choose_total_tries": 50, 2026-02-18T01:23:56.807 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_descend_once": 1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_vary_r": 1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "chooseleaf_stable": 1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "msr_descents": 100, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "msr_collision_tries": 100, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "straw_calc_version": 1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "allowed_bucket_algs": 54, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "profile": "jewel", 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "optimal_tunables": 1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "legacy_tunables": 0, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "minimum_required_version": "jewel", 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables": 1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables2": 1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "has_v2_rules": 1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables3": 1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "has_v3_rules": 0, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "has_v4_buckets": 1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "require_feature_tunables5": 1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "has_v5_rules": 0, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "has_msr_rules": 0 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "choose_args": {} 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "fsmap": { 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "btime": "2026-02-18T01:21:58:031694+0000", 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "default_fscid": -1, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "compat": { 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "compat": {}, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "ro_compat": {}, 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "incompat": { 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "feature_1": "base v0.20", 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "feature_2": "client writeable ranges", 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "feature_3": "default file layouts on dirs", 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "feature_4": "dir inode in separate object", 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "feature_5": "mds uses versioned encoding", 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-18T01:23:56.808 INFO:tasks.workunit.client.0.trial080.stdout: "feature_8": "no anchor table", 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "feature_9": "file layout v2", 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "feature_10": "snaprealm v2", 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "feature_11": "minor log segments", 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "feature_12": "quiesce subvolumes" 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "feature_flags": { 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "enable_multiple": true, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "ever_enabled_multiple": true 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "standbys": [], 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "filesystems": [] 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_first_committed": 1, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "mdsmap_last_committed": 1, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "auth": { 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 5, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_secrets": 3 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 1, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_active": 1, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_unknown": 0, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_osd": 3, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "pool_sum": { 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 52200, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 101, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 1, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 303, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 101, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 101, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:23:56.809 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 101, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 101, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 18, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 18, 2026-02-18T01:23:56.810 INFO:tasks.workunit.client.0.trial080.stdout: "up": 3, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 3, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 0 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum": { 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 3, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 85076, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2276, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 29, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 82722, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314487724, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322035429376, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2330624, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 1594693, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 30299, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 84707749 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 0, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.811 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "osd_sum_by_class": { 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "ssd": { 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "up_from": 0, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 0, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "num_pgs": 3, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "num_osds": 3, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_osds": 3, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "num_per_pool_omap_osds": 3, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "kb": 314572800, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used": 85076, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_data": 2276, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_omap": 29, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "kb_used_meta": 82722, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "kb_avail": 314487724, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "statfs": { 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "total": 322122547200, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "available": 322035429376, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 2330624, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 1594693, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 30299, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 84707749 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "hb_peers": [], 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "snap_trim_queue_len": 0, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "num_snap_trimming": 0, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "num_shards_repaired": 0, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "op_queue_age_hist": { 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "histogram": [], 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "upper_bound": 1 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "perf_stat": { 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ms": 0, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ms": 0, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "commit_latency_ns": 0, 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: "apply_latency_ns": 0 2026-02-18T01:23:56.812 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "alerts": [], 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "network_ping_times": [] 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "pool_stats": [ 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": 1, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg": 1, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "stat_sum": { 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes": 52200, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects": 101, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_clones": 1, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_object_copies": 303, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_missing": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_degraded": 101, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_misplaced": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_unfound": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_dirty": 101, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_whiteouts": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_read": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_read_kb": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_write": 101, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_write_kb": 101, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_scrub_errors": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_deep_scrub_errors": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_recovered": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_recovered": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_keys_recovered": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_omap": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_kb": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_kb": 0, 2026-02-18T01:23:56.813 INFO:tasks.workunit.client.0.trial080.stdout: "num_promote": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_high": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "num_flush_mode_low": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_some": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "num_evict_mode_full": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_pinned": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "num_legacy_snapsets": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "num_large_omap_objects": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_manifest": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_bytes": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "num_omap_keys": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "num_objects_repaired": 0 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "store_stats": { 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "total": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "available": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "internally_reserved": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "allocated": 1241088, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "data_stored": 1241088, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_allocated": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "data_compressed_original": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "omap_allocated": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "internal_metadata": 0 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "log_size": 18, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "ondisk_log_size": 18, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "up": 3, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "acting": 3, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "num_store_stats": 3 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "osd_stats": [ 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 193273528330 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 42949672975 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.814 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "seq": 210453397513 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_state": [ 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "state": "active+undersized+degraded", 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num": 1 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "pool_pg_unavailable_map": [ 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "poolid": "1", 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "pgs": [] 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_pg_by_osd": [ 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2147483647, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 1, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 2, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 1, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 0, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 1, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 1, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "osd": 1, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_primary_pg": 0, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_acting_pg": 0, 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: "num_up_not_acting_pg": 0 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.815 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": [ 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: { 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "pool": 1, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "purged_snaps": {} 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: ], 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "servicemap": { 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "epoch": 3, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "modified": "2026-02-18T01:23:06.491695+0000", 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "services": { 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "osd": { 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "daemons": { 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "summary": "", 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "0": { 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "start_epoch": 0, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "start_stamp": "0.000000", 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "gid": 0, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "metadata": {}, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "task_status": {} 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "2": { 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "start_epoch": 0, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "start_stamp": "0.000000", 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "gid": 0, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "metadata": {}, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "task_status": {} 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: }, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_first_committed": 1, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "mgrstat_last_committed": 60, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "logm_first_committed": 1, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "logm_last_committed": 317, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "paxos": { 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "first_committed": 1, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "last_committed": 438, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "last_pn": 0, 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: "accepted_pn": 0 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout: } 2026-02-18T01:23:56.816 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:23:56.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-18T01:23:56.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:341: TEST_divergent_ec: echo 'delay recovery' 2026-02-18T01:23:56.817 INFO:tasks.workunit.client.0.trial080.stdout:delay recovery 2026-02-18T01:23:56.817 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:342: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:23:56.966 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:23:56.966 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-18T01:23:21.926296+0000 42'102 50:144 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:01:20.766543+0000 0 0 2026-02-18T01:23:56.966 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:23:56.966 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:23:56.966 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:23:56.975 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-18T01:23:56.976 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.0 2026-02-18T01:23:56.976 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T01:23:56.976 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T01:23:56.976 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:23:56.976 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:23:56.976 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:23:56.977 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.0.asok 2026-02-18T01:23:56.977 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-18T01:23:56.977 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.0.asok set_recovery_delay 100000 2026-02-18T01:23:57.040 INFO:tasks.workunit.client.0.trial080.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-18T01:23:57.046 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-18T01:23:57.047 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.2 2026-02-18T01:23:57.047 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-18T01:23:57.047 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-18T01:23:57.048 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:23:57.048 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:23:57.048 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:23:57.048 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.2.asok 2026-02-18T01:23:57.048 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-18T01:23:57.049 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.2.asok set_recovery_delay 100000 2026-02-18T01:23:57.104 INFO:tasks.workunit.client.0.trial080.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-18T01:23:57.109 INFO:tasks.workunit.client.0.trial080.stdout:revive divergent 1 2026-02-18T01:23:57.110 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:349: TEST_divergent_ec: echo 'revive divergent 1' 2026-02-18T01:23:57.110 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:350: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:23:57.325 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:23:57.325 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-18T01:23:21.926296+0000 42'102 50:144 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:01:20.766543+0000 0 0 2026-02-18T01:23:57.325 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:23:57.326 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:23:57.326 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:23:57.335 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:351: TEST_divergent_ec: ceph osd set noup 2026-02-18T01:23:57.661 INFO:tasks.workunit.client.0.trial080.stderr:noup is set 2026-02-18T01:23:57.676 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:352: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-18T01:23:57.676 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:23:57.676 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:23:57.676 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:23:57.676 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:23:57.676 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-18T01:23:57.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:23:57.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:23:57.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:23:57.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:23:57.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-18T01:23:57.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-18T01:23:57.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:23:57.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:23:57.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:23:57.677 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:23:57.677 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:23:57.677 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:23:57.678 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:23:57.678 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:23:57.678 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:23:57.678 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:23:57.678 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:23:57.678 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:23:57.678 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:23:57.678 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:23:57.678 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:23:57.678 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:23:57.678 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:23:57.678 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:23:57.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:23:57.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:23:57.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-18T01:23:57.679 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:23:57.680 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:23:57.680 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:23:57.680 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-18T01:23:57.681 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:23:57.681 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:23:57.681 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:23:57.681 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:23:57.700 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:57.690+0000 7fccee9eaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:23:57.702 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:57.690+0000 7fccee9eaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:23:57.703 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:57.690+0000 7fccee9eaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:23:57.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-18T01:23:57.888 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:353: TEST_divergent_ec: sleep 5 2026-02-18T01:23:58.097 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:58.086+0000 7fccee9eaa40 -1 Falling back to public interface 2026-02-18T01:23:58.791 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:23:58.778+0000 7fccee9eaa40 -1 osd.1 30 log_to_monitors true 2026-02-18T01:24:02.889 INFO:tasks.workunit.client.0.trial080.stdout:delay recovery divergent 2026-02-18T01:24:02.890 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:355: TEST_divergent_ec: echo 'delay recovery divergent' 2026-02-18T01:24:02.890 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:356: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:24:03.085 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:24:03.085 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-18T01:23:21.926296+0000 42'102 53:150 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:01:20.766543+0000 0 0 2026-02-18T01:24:03.085 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:24:03.085 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:24:03.086 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:24:03.094 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: get_asok_path osd.1 2026-02-18T01:24:03.094 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T01:24:03.094 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T01:24:03.095 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:24:03.095 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:03.095 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:24:03.095 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16037/ceph-osd.1.asok 2026-02-18T01:24:03.095 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: CEPH_ARGS= 2026-02-18T01:24:03.095 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16037/ceph-osd.1.asok set_recovery_delay 100000 2026-02-18T01:24:03.148 INFO:tasks.workunit.client.0.trial080.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-18T01:24:03.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:359: TEST_divergent_ec: ceph osd unset noup 2026-02-18T01:24:03.517 INFO:tasks.workunit.client.0.trial080.stderr:noup is unset 2026-02-18T01:24:03.529 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:361: TEST_divergent_ec: wait_for_osd up 0 2026-02-18T01:24:03.529 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:24:03.529 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:24:03.529 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:24:03.529 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:24:03.529 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:03.530 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:03.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:24:03.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:03.531 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:24:03.742 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 45 up_thru 49 down_at 44 last_clean_interval [37,42) [v2:127.0.0.1:6800/2664791185,v1:127.0.0.1:6801/2664791185] [v2:127.0.0.1:6802/2664791185,v1:127.0.0.1:6803/2664791185] exists,up 93913594-6b7e-4e41-b650-1ee84f36d147 2026-02-18T01:24:03.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:24:03.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:24:03.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:24:03.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:362: TEST_divergent_ec: wait_for_osd up 1 2026-02-18T01:24:03.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:24:03.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:24:03.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:24:03.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:24:03.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:03.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:24:03.744 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:03.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:03.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:24:03.957 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 32 last_clean_interval [10,30) [v2:127.0.0.1:6818/1996260088,v1:127.0.0.1:6819/1996260088] [v2:127.0.0.1:6820/1996260088,v1:127.0.0.1:6821/1996260088] exists,up 06b951d7-efc6-4811-9cbd-30f3073451e6 2026-02-18T01:24:03.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:24:03.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:24:03.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:24:03.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:363: TEST_divergent_ec: wait_for_osd up 2 2026-02-18T01:24:03.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:24:03.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:24:03.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:24:03.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:24:03.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:03.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:24:03.959 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:03.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:03.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:24:04.170 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 49 up_thru 0 down_at 48 last_clean_interval [39,42) [v2:127.0.0.1:6810/3589176353,v1:127.0.0.1:6811/3589176353] [v2:127.0.0.1:6812/3589176353,v1:127.0.0.1:6813/3589176353] exists,up 0035cdac-f15f-47cf-b751-9feed4d3ddbe 2026-02-18T01:24:04.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:24:04.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:24:04.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:24:04.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:365: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:24:04.370 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:24:04.370 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-18T01:23:21.926296+0000 42'102 53:150 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:01:20.766543+0000 0 0 2026-02-18T01:24:04.370 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:24:04.371 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:24:04.371 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:24:04.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:366: TEST_divergent_ec: echo 'wait for peering' 2026-02-18T01:24:04.381 INFO:tasks.workunit.client.0.trial080.stdout:wait for peering 2026-02-18T01:24:04.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:367: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:24:04.581 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:24:04.581 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 peering 2026-02-18T01:24:03.512841+0000 30'104 55:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:24:04.581 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:24:04.581 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:24:04.581 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:24:04.589 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:368: TEST_divergent_ec: rados -p test put foo /tmp/tmp.U1sUw4n52M 2026-02-18T01:24:04.619 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:369: TEST_divergent_ec: rm -f /tmp/tmp.U1sUw4n52M 2026-02-18T01:24:04.620 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:371: TEST_divergent_ec: echo 'killing divergent 1' 2026-02-18T01:24:04.621 INFO:tasks.workunit.client.0.trial080.stdout:killing divergent 1 2026-02-18T01:24:04.621 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:372: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:24:04.823 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:24:04.823 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 peering 2026-02-18T01:24:03.512841+0000 30'104 55:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:24:04.823 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:24:04.823 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:24:04.823 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:24:04.831 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:373: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.1 2026-02-18T01:24:04.832 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:24:04.832 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:24:04.833 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:24:04.833 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:24:04.833 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:24:04.940 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:24:04.940 INFO:tasks.workunit.client.0.trial080.stdout:reviving divergent 1 2026-02-18T01:24:04.941 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:375: TEST_divergent_ec: echo 'reviving divergent 1' 2026-02-18T01:24:04.941 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:376: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:24:05.139 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:24:05.140 INFO:tasks.workunit.client.0.trial080.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 peering 2026-02-18T01:24:03.512841+0000 30'104 55:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 no scrub is scheduled 0 0 2026-02-18T01:24:05.140 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:24:05.140 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:24:05.140 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:24:05.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:377: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-18T01:24:05.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-18T01:24:05.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:24:05.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:24:05.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:24:05.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-18T01:24:05.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-18T01:24:05.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:24:05.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:24:05.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:24:05.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-18T01:24:05.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-18T01:24:05.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:24:05.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:24:05.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-18T01:24:05.153 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:24:05.153 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:24:05.153 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:24:05.153 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:24:05.153 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:05.154 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:24:05.154 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:24:05.155 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' 2026-02-18T01:24:05.155 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:24:05.155 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-18T01:24:05.155 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-18T01:24:05.155 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:24:05.155 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:24:05.156 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:24:05.156 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:24:05.156 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:24:05.156 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:24:05.156 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-18T01:24:05.156 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:24:05.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:24:05.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7426e8e1-23b3-468d-99f4-892559a19a37 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16037/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:24:05.157 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-18T01:24:05.157 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:24:05.158 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:24:05.158 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:24:05.158 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:24:05.180 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:05.170+0000 7f5f47446a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:05.181 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:05.170+0000 7f5f47446a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:05.182 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:05.170+0000 7f5f47446a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:05.368 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T01:24:05.369 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:24:05.369 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:24:05.369 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:24:05.369 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:24:05.369 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:05.369 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:24:05.369 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:05.370 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:05.370 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:24:05.587 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 32 last_clean_interval [10,30) [v2:127.0.0.1:6818/1996260088,v1:127.0.0.1:6819/1996260088] [v2:127.0.0.1:6820/1996260088,v1:127.0.0.1:6821/1996260088] exists,up 06b951d7-efc6-4811-9cbd-30f3073451e6 2026-02-18T01:24:05.588 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:24:05.588 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:24:05.588 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:24:05.588 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:379: TEST_divergent_ec: sleep 20 2026-02-18T01:24:05.669 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:05.658+0000 7f5f47446a40 -1 Falling back to public interface 2026-02-18T01:24:06.217 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:06.206+0000 7f5f47446a40 -1 osd.1 56 log_to_monitors true 2026-02-18T01:24:25.589 INFO:tasks.workunit.client.0.trial080.stdout:allowing recovery 2026-02-18T01:24:25.590 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:381: TEST_divergent_ec: echo 'allowing recovery' 2026-02-18T01:24:25.590 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:382: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:24:25.789 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:24:25.790 INFO:tasks.workunit.client.0.trial080.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-18T01:24:06.580396+0000 56'103 60:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:22:39.575793+0000 0 0 2026-02-18T01:24:25.790 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:24:25.790 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:24:25.790 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:24:25.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-18T01:24:25.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-18T01:24:25.883 INFO:tasks.workunit.client.0.trial080.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-18T01:24:25.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-18T01:24:25.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-18T01:24:25.973 INFO:tasks.workunit.client.0.trial080.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-18T01:24:25.980 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-18T01:24:25.980 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-18T01:24:26.060 INFO:tasks.workunit.client.0.trial080.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-18T01:24:26.067 INFO:tasks.workunit.client.0.trial080.stdout:reading divergent objects 2026-02-18T01:24:26.068 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:389: TEST_divergent_ec: echo 'reading divergent objects' 2026-02-18T01:24:26.068 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: ceph pg dump pgs 2026-02-18T01:24:26.281 INFO:tasks.workunit.client.0.trial080.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T01:24:26.281 INFO:tasks.workunit.client.0.trial080.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-18T01:24:06.580396+0000 56'103 60:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T01:22:10.293473+0000 0'0 2026-02-18T01:22:10.293473+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:22:39.575793+0000 0 0 2026-02-18T01:24:26.281 INFO:tasks.workunit.client.0.trial080.stdout: 2026-02-18T01:24:26.282 INFO:tasks.workunit.client.0.trial080.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T01:24:26.282 INFO:tasks.workunit.client.0.trial080.stderr:dumped pgs 2026-02-18T01:24:26.291 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: expr 2 + 2 2026-02-18T01:24:26.292 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: seq 1 4 2026-02-18T01:24:26.293 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:24:26.293 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_1 td/divergent-priors/existing 2026-02-18T01:24:26.315 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:24:26.315 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_2 td/divergent-priors/existing 2026-02-18T01:24:26.336 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:24:26.336 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_3 td/divergent-priors/existing 2026-02-18T01:24:26.363 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-18T01:24:26.364 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_4 td/divergent-priors/existing 2026-02-18T01:24:26.390 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:395: TEST_divergent_ec: rm -f td/divergent-priors/existing 2026-02-18T01:24:26.392 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-18T01:24:26.393 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-18T01:24:26.397 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:1 entries: 30'103 (29'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-18T01:22:23.501003+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-18T01:24:26.397 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 20 _merge_object_divergent_entries: keeping 30'103 (29'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-18T01:22:23.501003+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-18T01:24:26.397 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:24:26.397 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version: 29'99 first_divergent_update: 30'103 last_divergent_update: 30'103 2026-02-18T01:24:26.397 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 has no more recent entries in log 2026-02-18T01:24:26.397 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version or op type indicates creation, deleting 2026-02-18T01:24:26.397 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:head entries: 30'104 (29'99) modify 1:7a80c0d5:::existing_99:head by client.4563.0:1 2026-02-18T01:22:28.386833+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-18T01:24:26.398 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 20 _merge_object_divergent_entries: keeping 30'104 (29'99) modify 1:7a80c0d5:::existing_99:head by client.4563.0:1 2026-02-18T01:22:28.386833+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-18T01:24:26.398 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:24:26.398 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head prior_version: 29'99 first_divergent_update: 30'104 last_divergent_update: 30'104 2026-02-18T01:24:26.398 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head has no more recent entries in log 2026-02-18T01:24:26.398 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head must be rolled back or recovered, attempting to rollback 2026-02-18T01:24:26.398 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head olog_can_rollback_to: 30'104 2026-02-18T01:24:26.398 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot rollback 30'104 (29'99) modify 1:7a80c0d5:::existing_99:head by client.4563.0:1 2026-02-18T01:22:28.386833+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-18T01:24:26.398 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot roll back, removing and adding to missing 2026-02-18T01:24:26.399 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 29'101 (29'100) modify 1:c156033e:::existing_100:head by client.4554.0:1 2026-02-18T01:22:27.320372+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false,29'102 (29'101) modify 1:c156033e:::existing_100:head by client.4560.0:1 2026-02-18T01:22:28.314665+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:24:26.399 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 20 _merge_object_divergent_entries: keeping 29'101 (29'100) modify 1:c156033e:::existing_100:head by client.4554.0:1 2026-02-18T01:22:27.320372+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:24:26.399 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 20 _merge_object_divergent_entries: keeping 29'102 (29'101) modify 1:c156033e:::existing_100:head by client.4560.0:1 2026-02-18T01:22:28.314665+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:24:26.399 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-18T01:24:26.399 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 29'100 first_divergent_update: 29'101 last_divergent_update: 29'102 2026-02-18T01:24:26.399 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-18T01:24:26.400 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-18T01:24:26.400 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 30'104 2026-02-18T01:24:26.400 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 29'102 (29'101) modify 1:c156033e:::existing_100:head by client.4560.0:1 2026-02-18T01:22:28.314665+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-18T01:24:26.400 INFO:tasks.workunit.client.0.trial080.stdout:td/divergent-priors/osd.1.log:2026-02-18T01:24:03.970+0000 7fcccc167640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-18T01:24:26.400 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-18T01:24:26.401 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: grep -q '_merge_object_divergent_entries.*rolled back' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-18T01:24:26.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:411: TEST_divergent_ec: echo success 2026-02-18T01:24:26.405 INFO:tasks.workunit.client.0.trial080.stdout:success 2026-02-18T01:24:26.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:413: TEST_divergent_ec: delete_pool test 2026-02-18T01:24:26.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-18T01:24:26.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-18T01:24:26.712 INFO:tasks.workunit.client.0.trial080.stderr:pool 'test' does not exist 2026-02-18T01:24:26.721 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:414: TEST_divergent_ec: kill_daemons td/divergent-priors 2026-02-18T01:24:26.722 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:24:26.723 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:24:26.723 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:24:26.723 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:24:26.723 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:24:32.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:24:32.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-18T01:24:32.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-18T01:24:32.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:24:32.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-18T01:24:32.040 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:24:32.040 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:24:32.040 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:24:32.040 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:24:32.040 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:24:32.046 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:24:32.047 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:24:32.048 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:24:32.048 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:24:32.049 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:24:32.049 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:24:32.049 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:24:32.050 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:24:32.050 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:24:32.051 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:24:32.051 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:24:32.052 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:24:32.053 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:24:32.053 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-18T01:24:32.069 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:24:32.069 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:32.070 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:24:32.070 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16037 2026-02-18T01:24:32.071 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:24:32.071 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:24:32.071 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T01:24:32.072 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/divergent-priors 0 2026-02-18T01:24:32.072 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-18T01:24:32.072 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T01:24:32.072 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-18T01:24:32.072 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:24:32.072 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:24:32.073 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:24:32.073 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:24:32.073 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:24:32.074 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:24:32.074 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:24:32.075 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:24:32.076 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:24:32.077 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:24:32.077 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:24:32.077 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:24:32.078 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:24:32.079 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:24:32.079 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:24:32.079 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:24:32.080 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:24:32.082 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T01:24:32.082 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-18T01:24:32.083 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:24:32.083 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:32.083 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16037 2026-02-18T01:24:32.083 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16037 2026-02-18T01:24:32.084 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:24:32.084 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:24:32.084 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T01:24:32.086 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T01:24:32.086 DEBUG:teuthology.orchestra.run.trial080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T01:24:32.095 INFO:tasks.workunit:Running workunit osd/ec-error-rollforward.sh... 2026-02-18T01:24:32.095 DEBUG:teuthology.orchestra.run.trial080:workunit test osd/ec-error-rollforward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2026-02-18T01:24:32.145 INFO:tasks.workunit.client.0.trial080.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T01:24:32.149 INFO:tasks.workunit.client.0.trial080.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T01:24:32.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T01:24:32.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T01:24:32.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T01:24:32.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T01:24:32.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T01:24:32.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T01:24:32.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T01:24:32.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T01:24:32.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/ec-error-rollforward 2026-02-18T01:24:32.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:6: run: local dir=td/ec-error-rollforward 2026-02-18T01:24:32.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:7: run: shift 2026-02-18T01:24:32.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: export CEPH_MON=127.0.0.1:7132 2026-02-18T01:24:32.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: CEPH_MON=127.0.0.1:7132 2026-02-18T01:24:32.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:11: run: export CEPH_ARGS 2026-02-18T01:24:32.150 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: uuidgen 2026-02-18T01:24:32.151 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: CEPH_ARGS+='--fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none ' 2026-02-18T01:24:32.151 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2026-02-18T01:24:32.151 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: export margin=10 2026-02-18T01:24:32.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: margin=10 2026-02-18T01:24:32.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: export objects=200 2026-02-18T01:24:32.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: objects=200 2026-02-18T01:24:32.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: export poolname=test 2026-02-18T01:24:32.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: poolname=test 2026-02-18T01:24:32.152 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: set 2026-02-18T01:24:32.152 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T01:24:32.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: local funcs=TEST_ec_error_rollforward 2026-02-18T01:24:32.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:19: run: for func in $funcs 2026-02-18T01:24:32.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:20: run: setup td/ec-error-rollforward 2026-02-18T01:24:32.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ec-error-rollforward 2026-02-18T01:24:32.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ec-error-rollforward 2026-02-18T01:24:32.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-18T01:24:32.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:24:32.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-18T01:24:32.154 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:24:32.154 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:24:32.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:24:32.154 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:24:32.155 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:24:32.155 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:24:32.155 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:24:32.156 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:24:32.157 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:24:32.158 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:24:32.158 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:24:32.158 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:24:32.159 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:24:32.159 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:24:32.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:24:32.160 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:24:32.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:24:32.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:24:32.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-18T01:24:32.163 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:24:32.164 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:32.164 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:32.164 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.71600 2026-02-18T01:24:32.165 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:24:32.165 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:24:32.165 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ec-error-rollforward 2026-02-18T01:24:32.167 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:24:32.167 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:32.167 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:32.167 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.71600 2026-02-18T01:24:32.168 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:24:32.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T01:24:32.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T01:24:32.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:24:32.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ec-error-rollforward 1' TERM HUP INT 2026-02-18T01:24:32.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:21: run: TEST_ec_error_rollforward td/ec-error-rollforward 2026-02-18T01:24:32.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:27: TEST_ec_error_rollforward: local dir=td/ec-error-rollforward 2026-02-18T01:24:32.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:28: TEST_ec_error_rollforward: run_mon td/ec-error-rollforward a 2026-02-18T01:24:32.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ec-error-rollforward 2026-02-18T01:24:32.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:24:32.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:24:32.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:24:32.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ec-error-rollforward/a 2026-02-18T01:24:32.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ec-error-rollforward/a --run-dir=td/ec-error-rollforward 2026-02-18T01:24:32.193 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:24:32.193 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:24:32.193 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:24:32.193 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:24:32.194 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:32.194 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:32.194 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:32.194 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ec-error-rollforward/a '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --mon-cluster-log-file=td/ec-error-rollforward/log --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T01:24:32.221 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:24:32.222 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:24:32.222 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:24:32.222 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:24:32.222 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:24:32.222 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:24:32.224 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:24:32.224 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:24:32.224 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:24:32.224 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:24:32.224 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:32.224 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:32.224 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.71600/ceph-mon.a.asok 2026-02-18T01:24:32.224 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:24:32.224 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.71600/ceph-mon.a.asok config get fsid 2026-02-18T01:24:32.278 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:24:32.278 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:24:32.278 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:24:32.278 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:24:32.278 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:24:32.279 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:24:32.279 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:24:32.280 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:24:32.280 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:24:32.280 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:32.280 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:32.280 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.71600/ceph-mon.a.asok 2026-02-18T01:24:32.280 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:24:32.280 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.71600/ceph-mon.a.asok config get mon_host 2026-02-18T01:24:32.333 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:29: TEST_ec_error_rollforward: run_mgr td/ec-error-rollforward x 2026-02-18T01:24:32.333 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ec-error-rollforward 2026-02-18T01:24:32.333 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:24:32.333 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T01:24:32.333 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:24:32.333 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ec-error-rollforward/x 2026-02-18T01:24:32.334 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:24:32.444 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:24:32.444 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:24:32.444 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:24:32.444 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:24:32.444 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:32.444 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:32.444 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:32.445 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:24:32.445 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ec-error-rollforward/x '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:24:32.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:30: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 0 2026-02-18T01:24:32.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-18T01:24:32.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:24:32.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:24:32.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:24:32.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/0 2026-02-18T01:24:32.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-18T01:24:32.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:24:32.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:24:32.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:24:32.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-18T01:24:32.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-18T01:24:32.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:24:32.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:24:32.467 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-18T01:24:32.467 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:24:32.467 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:24:32.467 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:24:32.467 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:24:32.468 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:24:32.469 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:24:32.469 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:24:32.469 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/0 2026-02-18T01:24:32.469 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:24:32.469 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=acedc824-2fa0-4096-9e53-8ea5e6c4d071 2026-02-18T01:24:32.469 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 acedc824-2fa0-4096-9e53-8ea5e6c4d071' 2026-02-18T01:24:32.469 INFO:tasks.workunit.client.0.trial080.stdout:add osd0 acedc824-2fa0-4096-9e53-8ea5e6c4d071 2026-02-18T01:24:32.470 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:24:32.477 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDQFJVpRN4LHBAAlSZCpf1GOCX1UxVIJeqWCw== 2026-02-18T01:24:32.477 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDQFJVpRN4LHBAAlSZCpf1GOCX1UxVIJeqWCw=="}' 2026-02-18T01:24:32.477 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new acedc824-2fa0-4096-9e53-8ea5e6c4d071 -i td/ec-error-rollforward/0/new.json 2026-02-18T01:24:32.587 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:32.595 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/0/new.json 2026-02-18T01:24:32.596 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDQFJVpRN4LHBAAlSZCpf1GOCX1UxVIJeqWCw== --osd-uuid acedc824-2fa0-4096-9e53-8ea5e6c4d071 2026-02-18T01:24:32.611 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:32.602+0000 7f117330aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:32.612 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:32.606+0000 7f117330aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:32.613 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:32.606+0000 7f117330aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:32.614 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:32.606+0000 7f117330aa40 -1 bdev(0x561552368c00 td/ec-error-rollforward/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:24:32.614 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:32.606+0000 7f117330aa40 -1 bluestore(td/ec-error-rollforward/0) _read_fsid unparsable uuid 2026-02-18T01:24:33.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/0/keyring 2026-02-18T01:24:33.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:24:33.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:24:33.406 INFO:tasks.workunit.client.0.trial080.stdout:adding osd0 key to auth repository 2026-02-18T01:24:33.406 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:24:33.526 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:24:33.526 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:24:33.527 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:24:33.527 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:24:33.527 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:24:33.527 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:24:33.548 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:33.538+0000 7fa58b0a6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:33.550 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:33.542+0000 7fa58b0a6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:33.552 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:33.542+0000 7fa58b0a6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:33.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:24:33.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:24:33.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:24:33.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:24:33.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:24:33.633 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:33.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:33.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:24:33.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:33.634 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:24:33.736 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:24:34.094 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:34.085+0000 7fa58b0a6a40 -1 Falling back to public interface 2026-02-18T01:24:34.738 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:24:34.738 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:34.738 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:24:34.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:24:34.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:34.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:24:34.848 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:24:34.978 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:34.969+0000 7fa58b0a6a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:24:35.849 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:24:35.850 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:35.850 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:24:35.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:24:35.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:35.851 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:24:36.057 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2086408350,v1:127.0.0.1:6801/2086408350] [v2:127.0.0.1:6802/2086408350,v1:127.0.0.1:6803/2086408350] exists,up acedc824-2fa0-4096-9e53-8ea5e6c4d071 2026-02-18T01:24:36.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:24:36.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:24:36.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:24:36.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:31: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 1 2026-02-18T01:24:36.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-18T01:24:36.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:24:36.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T01:24:36.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:24:36.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/1 2026-02-18T01:24:36.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-18T01:24:36.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:24:36.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:24:36.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:24:36.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:36.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:24:36.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:24:36.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:24:36.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-18T01:24:36.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-18T01:24:36.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:24:36.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:24:36.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:24:36.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:24:36.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:24:36.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:24:36.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/1 2026-02-18T01:24:36.064 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:24:36.064 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3326940e-4b85-4f08-a304-174ecacc0b60 2026-02-18T01:24:36.064 INFO:tasks.workunit.client.0.trial080.stdout:add osd1 3326940e-4b85-4f08-a304-174ecacc0b60 2026-02-18T01:24:36.065 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 3326940e-4b85-4f08-a304-174ecacc0b60' 2026-02-18T01:24:36.065 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:24:36.073 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDUFJVpXUn6AxAACZd3WJkPXzartGNkxslgYw== 2026-02-18T01:24:36.074 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDUFJVpXUn6AxAACZd3WJkPXzartGNkxslgYw=="}' 2026-02-18T01:24:36.074 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3326940e-4b85-4f08-a304-174ecacc0b60 -i td/ec-error-rollforward/1/new.json 2026-02-18T01:24:36.296 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:24:36.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/1/new.json 2026-02-18T01:24:36.307 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDUFJVpXUn6AxAACZd3WJkPXzartGNkxslgYw== --osd-uuid 3326940e-4b85-4f08-a304-174ecacc0b60 2026-02-18T01:24:36.329 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:36.321+0000 7f927cb73a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:36.331 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:36.321+0000 7f927cb73a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:36.332 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:36.321+0000 7f927cb73a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:36.332 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:36.325+0000 7f927cb73a40 -1 bdev(0x55cb82d06c00 td/ec-error-rollforward/1/block) open stat got: (1) Operation not permitted 2026-02-18T01:24:36.332 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:36.325+0000 7f927cb73a40 -1 bluestore(td/ec-error-rollforward/1) _read_fsid unparsable uuid 2026-02-18T01:24:36.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/1/keyring 2026-02-18T01:24:36.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:24:36.978 INFO:tasks.workunit.client.0.trial080.stdout:adding osd1 key to auth repository 2026-02-18T01:24:36.979 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T01:24:36.979 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:24:37.257 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T01:24:37.258 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:24:37.258 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:24:37.258 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:24:37.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:24:37.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:24:37.278 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:37.269+0000 7f5f1f67aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:37.280 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:37.269+0000 7f5f1f67aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:37.281 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:37.273+0000 7f5f1f67aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:37.469 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T01:24:37.469 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:24:37.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:24:37.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:24:37.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:24:37.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:37.470 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:37.472 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:24:37.472 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:37.472 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:24:37.634 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:37.625+0000 7f5f1f67aa40 -1 Falling back to public interface 2026-02-18T01:24:37.676 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:24:38.218 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:38.209+0000 7f5f1f67aa40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:24:38.677 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:24:38.678 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:38.678 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:24:38.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:24:38.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:38.679 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:24:38.885 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2008338068,v1:127.0.0.1:6811/2008338068] [v2:127.0.0.1:6812/2008338068,v1:127.0.0.1:6813/2008338068] exists,up 3326940e-4b85-4f08-a304-174ecacc0b60 2026-02-18T01:24:38.888 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:24:38.888 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:24:38.888 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:24:38.888 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:32: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 2 2026-02-18T01:24:38.888 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-18T01:24:38.888 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/2 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-18T01:24:38.889 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-18T01:24:38.890 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:24:38.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:24:38.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:24:38.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:24:38.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:24:38.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:24:38.891 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/2 2026-02-18T01:24:38.892 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:24:38.892 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=66d2983b-025d-4e44-9d77-73a954852173 2026-02-18T01:24:38.892 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 66d2983b-025d-4e44-9d77-73a954852173' 2026-02-18T01:24:38.892 INFO:tasks.workunit.client.0.trial080.stdout:add osd2 66d2983b-025d-4e44-9d77-73a954852173 2026-02-18T01:24:38.892 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:24:38.902 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDWFJVp6DVfNRAAa1SwIB9IrTyEhytpFE4KCQ== 2026-02-18T01:24:38.902 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDWFJVp6DVfNRAAa1SwIB9IrTyEhytpFE4KCQ=="}' 2026-02-18T01:24:38.902 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 66d2983b-025d-4e44-9d77-73a954852173 -i td/ec-error-rollforward/2/new.json 2026-02-18T01:24:39.110 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:24:39.120 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/2/new.json 2026-02-18T01:24:39.121 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDWFJVp6DVfNRAAa1SwIB9IrTyEhytpFE4KCQ== --osd-uuid 66d2983b-025d-4e44-9d77-73a954852173 2026-02-18T01:24:39.136 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:39.125+0000 7f5c87203a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:39.138 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:39.129+0000 7f5c87203a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:39.139 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:39.129+0000 7f5c87203a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:39.139 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:39.129+0000 7f5c87203a40 -1 bdev(0x5592941f2c00 td/ec-error-rollforward/2/block) open stat got: (1) Operation not permitted 2026-02-18T01:24:39.139 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:39.129+0000 7f5c87203a40 -1 bluestore(td/ec-error-rollforward/2) _read_fsid unparsable uuid 2026-02-18T01:24:39.812 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/2/keyring 2026-02-18T01:24:39.812 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:24:39.813 INFO:tasks.workunit.client.0.trial080.stdout:adding osd2 key to auth repository 2026-02-18T01:24:39.813 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T01:24:39.813 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:24:40.107 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:24:40.108 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T01:24:40.108 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:24:40.108 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:24:40.108 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:24:40.108 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:24:40.129 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:40.121+0000 7fa7b543fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:40.131 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:40.121+0000 7fa7b543fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:40.132 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:40.121+0000 7fa7b543fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:40.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T01:24:40.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:24:40.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:24:40.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:24:40.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:24:40.321 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:40.322 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:40.322 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:24:40.322 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:40.322 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:24:40.527 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:24:40.590 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:40.581+0000 7fa7b543fa40 -1 Falling back to public interface 2026-02-18T01:24:41.242 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:41.233+0000 7fa7b543fa40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:24:41.529 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:24:41.529 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:41.529 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:24:41.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:24:41.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:41.530 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:24:41.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:24:42.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:24:42.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:42.744 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:24:42.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:24:42.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:24:42.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:42.954 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1184980683,v1:127.0.0.1:6819/1184980683] [v2:127.0.0.1:6820/1184980683,v1:127.0.0.1:6821/1184980683] exists,up 66d2983b-025d-4e44-9d77-73a954852173 2026-02-18T01:24:42.957 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:24:42.957 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:24:42.957 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:24:42.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:33: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 3 2026-02-18T01:24:42.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-18T01:24:42.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:24:42.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T01:24:42.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:24:42.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/3 2026-02-18T01:24:42.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-18T01:24:42.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:24:42.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:24:42.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:42.959 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/3 2026-02-18T01:24:42.960 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:24:42.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=90a3b2d5-2270-488d-85c3-a688a4170f99 2026-02-18T01:24:42.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 90a3b2d5-2270-488d-85c3-a688a4170f99' 2026-02-18T01:24:42.961 INFO:tasks.workunit.client.0.trial080.stdout:add osd3 90a3b2d5-2270-488d-85c3-a688a4170f99 2026-02-18T01:24:42.962 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:24:42.970 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDaFJVplZNsORAA6e8Itq6xNkQm7Ht5PD3WwA== 2026-02-18T01:24:42.971 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDaFJVplZNsORAA6e8Itq6xNkQm7Ht5PD3WwA=="}' 2026-02-18T01:24:42.971 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 90a3b2d5-2270-488d-85c3-a688a4170f99 -i td/ec-error-rollforward/3/new.json 2026-02-18T01:24:43.188 INFO:tasks.workunit.client.0.trial080.stdout:3 2026-02-18T01:24:43.198 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/3/new.json 2026-02-18T01:24:43.199 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDaFJVplZNsORAA6e8Itq6xNkQm7Ht5PD3WwA== --osd-uuid 90a3b2d5-2270-488d-85c3-a688a4170f99 2026-02-18T01:24:43.222 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:43.213+0000 7f4668700a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:43.224 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:43.213+0000 7f4668700a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:43.225 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:43.217+0000 7f4668700a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:43.226 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:43.217+0000 7f4668700a40 -1 bdev(0x560ed6266c00 td/ec-error-rollforward/3/block) open stat got: (1) Operation not permitted 2026-02-18T01:24:43.226 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:43.217+0000 7f4668700a40 -1 bluestore(td/ec-error-rollforward/3) _read_fsid unparsable uuid 2026-02-18T01:24:43.864 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/3/keyring 2026-02-18T01:24:43.864 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:24:43.865 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T01:24:43.865 INFO:tasks.workunit.client.0.trial080.stdout:adding osd3 key to auth repository 2026-02-18T01:24:43.866 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:24:44.160 INFO:tasks.workunit.client.0.trial080.stdout:start osd.3 2026-02-18T01:24:44.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T01:24:44.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:24:44.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:24:44.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:24:44.160 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:24:44.174 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:44.165+0000 7f7a75703a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:44.176 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:44.165+0000 7f7a75703a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:44.177 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:44.169+0000 7f7a75703a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:44.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T01:24:44.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:24:44.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T01:24:44.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:24:44.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:24:44.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:44.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:24:44.374 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:44.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:44.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:24:44.554 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:44.545+0000 7f7a75703a40 -1 Falling back to public interface 2026-02-18T01:24:44.583 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:24:45.206 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:45.197+0000 7f7a75703a40 -1 osd.3 0 log_to_monitors true 2026-02-18T01:24:45.584 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:24:45.584 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:45.585 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:24:45.585 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:24:45.585 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:45.586 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:24:45.790 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:24:46.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:24:46.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:46.793 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:24:46.793 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:24:46.793 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:46.793 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:24:46.997 INFO:tasks.workunit.client.0.trial080.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2261901663,v1:127.0.0.1:6827/2261901663] [v2:127.0.0.1:6828/2261901663,v1:127.0.0.1:6829/2261901663] exists,up 90a3b2d5-2270-488d-85c3-a688a4170f99 2026-02-18T01:24:46.998 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:24:46.998 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:24:46.998 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:24:46.998 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:35: TEST_ec_error_rollforward: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-18T01:24:47.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:36: TEST_ec_error_rollforward: ceph osd pool create ec 1 1 erasure ec-profile 2026-02-18T01:24:47.624 INFO:tasks.workunit.client.0.trial080.stderr:pool 'ec' already exists 2026-02-18T01:24:47.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:38: TEST_ec_error_rollforward: rados -p ec put foo /etc/passwd 2026-02-18T01:24:49.202 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: cat td/ec-error-rollforward/osd.2.pid 2026-02-18T01:24:49.202 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: kill -STOP 75931 2026-02-18T01:24:49.203 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:43: TEST_ec_error_rollforward: pids=78337 2026-02-18T01:24:49.203 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:44: TEST_ec_error_rollforward: sleep 1 2026-02-18T01:24:49.204 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:42: TEST_ec_error_rollforward: rados -p ec rm foo 2026-02-18T01:24:50.204 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:46: TEST_ec_error_rollforward: pids+=' 78358' 2026-02-18T01:24:50.204 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:45: TEST_ec_error_rollforward: rados -p ec rm a 2026-02-18T01:24:50.205 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:48: TEST_ec_error_rollforward: pids+=' 78359' 2026-02-18T01:24:50.205 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:47: TEST_ec_error_rollforward: rados -p ec rm b 2026-02-18T01:24:50.205 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:50: TEST_ec_error_rollforward: pids+=' 78360' 2026-02-18T01:24:50.205 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:51: TEST_ec_error_rollforward: sleep 1 2026-02-18T01:24:50.205 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:49: TEST_ec_error_rollforward: rados -p ec rm c 2026-02-18T01:24:51.206 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:54: TEST_ec_error_rollforward: kill_daemons td/ec-error-rollforward KILL osd 2026-02-18T01:24:51.207 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:24:51.207 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:24:51.208 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:24:51.208 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:24:51.208 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:24:51.318 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:24:51.318 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:55: TEST_ec_error_rollforward: kill 78337 78358 78359 78360 2026-02-18T01:24:51.318 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:56: TEST_ec_error_rollforward: wait 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:58: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 0 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/0 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-18T01:24:51.320 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:24:51.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/0 2026-02-18T01:24:51.322 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:24:51.322 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:24:51.322 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:24:51.323 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/0/whoami 2026-02-18T01:24:51.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:24:51.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:24:51.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:24:51.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:24:51.345 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:51.337+0000 7f61bce28a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:51.347 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:51.337+0000 7f61bce28a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:51.348 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:51.337+0000 7f61bce28a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:51.533 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:24:51.533 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:24:51.533 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:24:51.533 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:24:51.533 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:24:51.533 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:51.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:24:51.534 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:51.534 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:51.535 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:24:51.744 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2086408350,v1:127.0.0.1:6801/2086408350] [v2:127.0.0.1:6802/2086408350,v1:127.0.0.1:6803/2086408350] exists,up acedc824-2fa0-4096-9e53-8ea5e6c4d071 2026-02-18T01:24:51.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:24:51.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:24:51.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:24:51.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:59: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 1 2026-02-18T01:24:51.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-18T01:24:51.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:24:51.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:24:51.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:24:51.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/1 2026-02-18T01:24:51.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-18T01:24:51.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:51.749 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:51.750 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:51.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:51.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:24:51.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-18T01:24:51.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-18T01:24:51.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:24:51.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:24:51.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:24:51.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:24:51.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:24:51.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:24:51.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/1 2026-02-18T01:24:51.751 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:24:51.752 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:24:51.752 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:24:51.752 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/1/whoami 2026-02-18T01:24:51.752 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:24:51.752 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:24:51.752 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:24:51.752 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:24:51.764 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:51.753+0000 7f84060aba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:51.766 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:51.757+0000 7f84060aba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:51.767 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:51.757+0000 7f84060aba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:51.810 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:51.801+0000 7f61bce28a40 -1 Falling back to public interface 2026-02-18T01:24:51.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T01:24:51.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:24:51.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:24:51.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:24:51.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:24:51.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:51.965 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:51.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:24:51.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:51.966 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:24:52.158 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:52.149+0000 7f84060aba40 -1 Falling back to public interface 2026-02-18T01:24:52.177 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 9 up_thru 22 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2008338068,v1:127.0.0.1:6811/2008338068] [v2:127.0.0.1:6812/2008338068,v1:127.0.0.1:6813/2008338068] exists,up 3326940e-4b85-4f08-a304-174ecacc0b60 2026-02-18T01:24:52.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:24:52.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:24:52.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:24:52.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:60: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 2 2026-02-18T01:24:52.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-18T01:24:52.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:24:52.180 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T01:24:52.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:24:52.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/2 2026-02-18T01:24:52.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-18T01:24:52.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:24:52.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:24:52.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:24:52.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-18T01:24:52.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-18T01:24:52.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:24:52.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:24:52.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-18T01:24:52.181 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:24:52.182 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:24:52.182 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:24:52.182 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:24:52.182 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:52.182 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:52.182 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:52.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:52.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:24:52.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-18T01:24:52.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-18T01:24:52.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:24:52.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:24:52.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:24:52.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:24:52.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:24:52.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:24:52.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/2 2026-02-18T01:24:52.183 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:24:52.184 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T01:24:52.184 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:24:52.184 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/2/whoami 2026-02-18T01:24:52.185 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T01:24:52.185 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:24:52.185 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:24:52.185 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:24:52.197 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:52.185+0000 7fddebac2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:52.198 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:52.189+0000 7fddebac2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:52.199 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:52.189+0000 7fddebac2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:52.392 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T01:24:52.392 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:24:52.392 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:24:52.392 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:24:52.392 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:24:52.392 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:52.393 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:52.393 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:24:52.393 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:52.393 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:24:52.601 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1184980683,v1:127.0.0.1:6819/1184980683] [v2:127.0.0.1:6820/1184980683,v1:127.0.0.1:6821/1184980683] exists,up 66d2983b-025d-4e44-9d77-73a954852173 2026-02-18T01:24:52.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:24:52.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:24:52.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:24:52.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:61: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 3 2026-02-18T01:24:52.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-18T01:24:52.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:24:52.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-18T01:24:52.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:24:52.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/3 2026-02-18T01:24:52.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-18T01:24:52.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:24:52.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:24:52.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:24:52.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-18T01:24:52.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-18T01:24:52.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:24:52.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:24:52.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-18T01:24:52.606 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:24:52.606 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:24:52.606 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:24:52.606 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:24:52.606 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:24:52.606 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:24:52.606 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:52.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' 2026-02-18T01:24:52.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:24:52.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-18T01:24:52.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-18T01:24:52.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:24:52.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:24:52.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:24:52.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:24:52.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:24:52.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:24:52.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/3 2026-02-18T01:24:52.608 INFO:tasks.workunit.client.0.trial080.stdout:start osd.3 2026-02-18T01:24:52.609 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-18T01:24:52.609 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4694d20-e482-45fc-a5dd-aeff45c319da --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71600/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:24:52.609 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/3/whoami 2026-02-18T01:24:52.609 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-18T01:24:52.609 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:24:52.609 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:24:52.609 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:24:52.625 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:52.617+0000 7f3ee002ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:52.626 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:52.617+0000 7f3ee002ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:52.627 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:52.617+0000 7f3ee002ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:24:52.680 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:52.669+0000 7f61bce28a40 -1 osd.0 24 log_to_monitors true 2026-02-18T01:24:52.750 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:52.741+0000 7fddebac2a40 -1 Falling back to public interface 2026-02-18T01:24:52.819 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-18T01:24:52.820 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:24:52.820 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T01:24:52.820 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:24:52.820 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:24:52.820 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:24:52.820 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:24:52.820 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:24:52.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:24:52.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:24:53.033 INFO:tasks.workunit.client.0.trial080.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2261901663,v1:127.0.0.1:6827/2261901663] [v2:127.0.0.1:6828/2261901663,v1:127.0.0.1:6829/2261901663] exists,up 90a3b2d5-2270-488d-85c3-a688a4170f99 2026-02-18T01:24:53.034 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:24:53.034 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:24:53.034 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:24:53.034 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:63: TEST_ec_error_rollforward: wait_for_clean 2026-02-18T01:24:53.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:24:53.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:24:53.035 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:24:53.035 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:24:53.035 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:24:53.035 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:24:53.036 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:24:53.036 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:24:53.036 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:24:53.094 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:53.085+0000 7f3ee002ca40 -1 Falling back to public interface 2026-02-18T01:24:53.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:24:53.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:24:53.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:24:53.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:24:53.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:24:53.139 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:24:53.148 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:53.137+0000 7f84060aba40 -1 osd.1 24 log_to_monitors true 2026-02-18T01:24:53.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:24:53.353 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:24:53.353 INFO:tasks.workunit.client.0.trial080.stderr:2 2026-02-18T01:24:53.353 INFO:tasks.workunit.client.0.trial080.stderr:3' 2026-02-18T01:24:53.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:24:53.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:24:53.354 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:24:53.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116995 2026-02-18T01:24:53.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116995 2026-02-18T01:24:53.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-115964116995' 2026-02-18T01:24:53.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:24:53.432 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:24:53.484 INFO:tasks.workunit.client.0.trial080.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-18T01:24:53.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-18T01:24:53.487 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-18T01:24:53.487 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-18T01:24:53.487 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:24:53.487 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:24:53.741 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:53.733+0000 7fddebac2a40 -1 osd.2 23 log_to_monitors true 2026-02-18T01:24:53.995 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:24:53.985+0000 7f3ee002ca40 -1 osd.3 24 log_to_monitors true 2026-02-18T01:24:58.572 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-18T01:24:58.572 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-18T01:24:58.572 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-115964116995 2-150323855363' 2026-02-18T01:24:58.572 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:24:58.573 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T01:24:58.648 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-18T01:24:58.648 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-18T01:24:58.648 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-115964116995 2-150323855363 3-154618822659' 2026-02-18T01:24:58.648 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:24:58.649 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-115964116995 2026-02-18T01:24:58.649 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:24:58.650 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:24:58.651 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-115964116995 2026-02-18T01:24:58.651 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:24:58.652 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116995 2026-02-18T01:24:58.652 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 115964116995 2026-02-18T01:24:58.653 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 115964116995' 2026-02-18T01:24:58.653 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:24:58.863 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116996 -lt 115964116995 2026-02-18T01:24:58.863 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:24:58.863 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-150323855363 2026-02-18T01:24:58.864 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:24:58.865 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:24:58.866 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-150323855363 2026-02-18T01:24:58.866 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:24:58.867 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=150323855363 2026-02-18T01:24:58.867 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 150323855363 2026-02-18T01:24:58.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 150323855363' 2026-02-18T01:24:58.868 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:24:59.089 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-18T01:24:59.089 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:24:59.089 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-154618822659 2026-02-18T01:24:59.090 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:24:59.091 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T01:24:59.091 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-154618822659 2026-02-18T01:24:59.091 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:24:59.093 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822659 2026-02-18T01:24:59.093 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.3 seq 154618822659 2026-02-18T01:24:59.094 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 154618822659' 2026-02-18T01:24:59.094 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T01:24:59.301 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-18T01:24:59.301 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:24:59.302 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:24:59.302 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:24:59.576 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-18T01:24:59.576 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:24:59.576 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:24:59.576 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:24:59.576 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:24:59.576 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:24:59.576 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:24:59.576 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:24:59.782 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-18T01:24:59.782 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:24:59.783 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:24:59.783 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:25:00.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-18T01:25:00.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:25:00.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:25:00.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:22: run: teardown td/ec-error-rollforward 2026-02-18T01:25:00.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-18T01:25:00.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:25:00.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-18T01:25:00.061 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:25:00.061 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:25:00.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:25:00.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:25:00.061 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:25:00.371 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:25:00.371 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:25:00.372 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:25:00.372 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:25:00.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:25:00.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:25:00.374 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:25:00.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:25:00.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:25:00.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:25:00.375 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:25:00.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:25:00.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:25:00.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-18T01:25:00.385 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:25:00.385 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:00.385 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:25:00.385 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.71600 2026-02-18T01:25:00.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:25:00.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:25:00.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T01:25:00.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/ec-error-rollforward 0 2026-02-18T01:25:00.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-18T01:25:00.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T01:25:00.387 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-18T01:25:00.387 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:25:00.388 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:25:00.388 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:25:00.388 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:25:00.388 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:25:00.389 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:25:00.389 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:25:00.390 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:25:00.390 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:25:00.391 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:25:00.391 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:25:00.392 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:25:00.392 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:25:00.393 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:25:00.393 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:25:00.393 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:25:00.394 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:25:00.395 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T01:25:00.395 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-18T01:25:00.396 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:25:00.396 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:00.396 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71600 2026-02-18T01:25:00.396 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.71600 2026-02-18T01:25:00.398 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:25:00.398 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:25:00.398 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T01:25:00.399 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T01:25:00.399 DEBUG:teuthology.orchestra.run.trial080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T01:25:00.449 INFO:tasks.workunit:Running workunit osd/osd-bench.sh... 2026-02-18T01:25:00.449 DEBUG:teuthology.orchestra.run.trial080:workunit test osd/osd-bench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2026-02-18T01:25:00.502 INFO:tasks.workunit.client.0.trial080.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T01:25:00.505 INFO:tasks.workunit.client.0.trial080.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T01:25:00.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T01:25:00.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T01:25:00.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T01:25:00.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T01:25:00.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T01:25:00.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T01:25:00.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T01:25:00.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T01:25:00.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/osd-bench 2026-02-18T01:25:00.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:22: run: local dir=td/osd-bench 2026-02-18T01:25:00.506 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:23: run: shift 2026-02-18T01:25:00.507 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: export CEPH_MON=127.0.0.1:7106 2026-02-18T01:25:00.507 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: CEPH_MON=127.0.0.1:7106 2026-02-18T01:25:00.507 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:26: run: export CEPH_ARGS 2026-02-18T01:25:00.507 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: uuidgen 2026-02-18T01:25:00.508 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: CEPH_ARGS+='--fsid=70c8c371-eca5-4789-8ece-ea9404f76826 --auth-supported=none ' 2026-02-18T01:25:00.508 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7106 ' 2026-02-18T01:25:00.508 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:29: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-18T01:25:00.508 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: set 2026-02-18T01:25:00.508 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T01:25:00.510 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: local funcs=TEST_bench 2026-02-18T01:25:00.510 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:32: run: for func in $funcs 2026-02-18T01:25:00.510 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:33: run: setup td/osd-bench 2026-02-18T01:25:00.510 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bench 2026-02-18T01:25:00.510 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bench 2026-02-18T01:25:00.510 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-18T01:25:00.510 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:25:00.511 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-18T01:25:00.511 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:25:00.511 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:25:00.511 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:25:00.511 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:25:00.511 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:25:00.511 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:25:00.512 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:25:00.512 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:25:00.512 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:25:00.513 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:25:00.513 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:25:00.513 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:25:00.514 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:25:00.514 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:25:00.514 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:25:00.515 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:25:00.515 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:25:00.516 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:25:00.517 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-18T01:25:00.518 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:25:00.518 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:00.518 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.80914 2026-02-18T01:25:00.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.80914 2026-02-18T01:25:00.519 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:25:00.519 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:25:00.519 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bench 2026-02-18T01:25:00.520 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:25:00.520 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:00.520 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.80914 2026-02-18T01:25:00.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.80914 2026-02-18T01:25:00.521 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:25:00.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T01:25:00.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T01:25:00.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:25:00.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bench 1' TERM HUP INT 2026-02-18T01:25:00.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:34: run: TEST_bench td/osd-bench 2026-02-18T01:25:00.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:40: TEST_bench: local dir=td/osd-bench 2026-02-18T01:25:00.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:42: TEST_bench: run_mon td/osd-bench a 2026-02-18T01:25:00.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bench 2026-02-18T01:25:00.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:25:00.524 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:25:00.524 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:25:00.524 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bench/a 2026-02-18T01:25:00.524 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bench/a --run-dir=td/osd-bench 2026-02-18T01:25:00.548 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:25:00.548 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:25:00.548 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:25:00.549 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:25:00.549 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:00.549 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.80914 2026-02-18T01:25:00.549 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.80914/$cluster-$name.asok' 2026-02-18T01:25:00.549 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bench/a '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.80914/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bench/log --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T01:25:00.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:25:00.577 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:25:00.577 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:25:00.577 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:25:00.577 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:25:00.578 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:25:00.578 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:25:00.578 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:25:00.578 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:25:00.579 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:25:00.579 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:00.579 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.80914 2026-02-18T01:25:00.579 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.80914/ceph-mon.a.asok 2026-02-18T01:25:00.579 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:25:00.579 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.80914/ceph-mon.a.asok config get fsid 2026-02-18T01:25:00.634 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:25:00.634 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:25:00.634 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:25:00.634 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:25:00.634 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:25:00.635 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:25:00.635 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:25:00.635 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:25:00.636 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:25:00.636 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:00.636 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.80914 2026-02-18T01:25:00.636 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.80914/ceph-mon.a.asok 2026-02-18T01:25:00.636 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:25:00.636 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.80914/ceph-mon.a.asok config get mon_host 2026-02-18T01:25:00.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:43: TEST_bench: run_mgr td/osd-bench x 2026-02-18T01:25:00.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bench 2026-02-18T01:25:00.691 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:25:00.691 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T01:25:00.691 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:25:00.691 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bench/x 2026-02-18T01:25:00.691 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:25:00.804 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:25:00.804 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:25:00.804 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:25:00.804 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:25:00.804 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:00.804 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.80914 2026-02-18T01:25:00.804 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.80914/$cluster-$name.asok' 2026-02-18T01:25:00.805 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:25:00.805 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bench/x '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.80914/$cluster-$name.asok' --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:25:00.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:44: TEST_bench: run_osd td/osd-bench 0 2026-02-18T01:25:00.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bench 2026-02-18T01:25:00.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:25:00.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:25:00.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:25:00.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bench/0 2026-02-18T01:25:00.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=70c8c371-eca5-4789-8ece-ea9404f76826 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 ' 2026-02-18T01:25:00.827 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bench/0' 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bench/0/journal' 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bench' 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:00.828 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.80914 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.80914/$cluster-$name.asok' 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.80914/$cluster-$name.asok' 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bench/$name.log' 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bench/$name.pid' 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:25:00.829 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:25:00.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bench/0 2026-02-18T01:25:00.830 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:25:00.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ef1ffc9a-0047-4eb2-9834-928a3ae7106d 2026-02-18T01:25:00.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 ef1ffc9a-0047-4eb2-9834-928a3ae7106d' 2026-02-18T01:25:00.831 INFO:tasks.workunit.client.0.trial080.stdout:add osd0 ef1ffc9a-0047-4eb2-9834-928a3ae7106d 2026-02-18T01:25:00.831 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:25:00.840 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDsFJVp9WSmMRAAtqbHv4JbIN86N4usYVNksQ== 2026-02-18T01:25:00.840 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDsFJVp9WSmMRAAtqbHv4JbIN86N4usYVNksQ=="}' 2026-02-18T01:25:00.841 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ef1ffc9a-0047-4eb2-9834-928a3ae7106d -i td/osd-bench/0/new.json 2026-02-18T01:25:00.947 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:25:00.955 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bench/0/new.json 2026-02-18T01:25:00.956 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=70c8c371-eca5-4789-8ece-ea9404f76826 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.80914/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDsFJVp9WSmMRAAtqbHv4JbIN86N4usYVNksQ== --osd-uuid ef1ffc9a-0047-4eb2-9834-928a3ae7106d 2026-02-18T01:25:00.971 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:00.961+0000 7fbb86ce4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:00.973 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:00.961+0000 7fbb86ce4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:00.974 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:00.965+0000 7fbb86ce4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:00.974 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:00.965+0000 7fbb86ce4a40 -1 bdev(0x55a28a646c00 td/osd-bench/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:25:00.974 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:00.965+0000 7fbb86ce4a40 -1 bluestore(td/osd-bench/0) _read_fsid unparsable uuid 2026-02-18T01:25:01.713 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bench/0/keyring 2026-02-18T01:25:01.713 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:25:01.714 INFO:tasks.workunit.client.0.trial080.stdout:adding osd0 key to auth repository 2026-02-18T01:25:01.714 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:25:01.714 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bench/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:25:01.838 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:25:01.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:25:01.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=70c8c371-eca5-4789-8ece-ea9404f76826 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.80914/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:25:01.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:25:01.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:25:01.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:25:01.861 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:01.853+0000 7f2732f32a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:01.864 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:01.853+0000 7f2732f32a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:01.866 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:01.857+0000 7f2732f32a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:01.946 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:25:01.946 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:25:01.946 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:25:01.946 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:25:01.946 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:25:01.946 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:01.946 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:25:01.946 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:25:01.946 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:01.946 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:25:02.058 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:25:02.375 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:02.365+0000 7f2732f32a40 -1 Falling back to public interface 2026-02-18T01:25:03.059 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:25:03.059 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:03.059 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:25:03.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:25:03.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:03.060 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:25:03.165 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:25:03.303 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:03.293+0000 7f2732f32a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:25:04.167 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:25:04.167 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:04.168 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:25:04.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:25:04.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:04.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:25:04.378 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3984683305,v1:127.0.0.1:6801/3984683305] [v2:127.0.0.1:6802/3984683305,v1:127.0.0.1:6803/3984683305] exists,up ef1ffc9a-0047-4eb2-9834-928a3ae7106d 2026-02-18T01:25:04.379 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:25:04.379 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:25:04.379 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:25:04.379 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: CEPH_ARGS= 2026-02-18T01:25:04.379 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: ceph-conf --show-config-value osd_bench_small_size_max_iops 2026-02-18T01:25:04.389 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: local osd_bench_small_size_max_iops=100 2026-02-18T01:25:04.389 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: CEPH_ARGS= 2026-02-18T01:25:04.390 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: ceph-conf --show-config-value osd_bench_large_size_max_throughput 2026-02-18T01:25:04.399 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: local osd_bench_large_size_max_throughput=104857600 2026-02-18T01:25:04.399 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: CEPH_ARGS= 2026-02-18T01:25:04.399 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: ceph-conf --show-config-value osd_bench_max_block_size 2026-02-18T01:25:04.410 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: local osd_bench_max_block_size=67108864 2026-02-18T01:25:04.411 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: CEPH_ARGS= 2026-02-18T01:25:04.411 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: ceph-conf --show-config-value osd_bench_duration 2026-02-18T01:25:04.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: local osd_bench_duration=30 2026-02-18T01:25:04.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:58: TEST_bench: expect_failure td/osd-bench osd_bench_max_block_size ceph tell osd.0 bench 1024 67108865 2026-02-18T01:25:04.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-18T01:25:04.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-18T01:25:04.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_max_block_size 2026-02-18T01:25:04.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-18T01:25:04.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-18T01:25:04.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 1024 67108865 2026-02-18T01:25:04.486 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-18T01:25:04.487 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-18T01:25:04.487 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_max_block_size td/osd-bench/out 2026-02-18T01:25:04.488 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-18T01:25:04.488 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:64: TEST_bench: local bsize=1024 2026-02-18T01:25:04.488 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:65: TEST_bench: local max_count=3072000 2026-02-18T01:25:04.488 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:66: TEST_bench: expect_failure td/osd-bench bench_small_size_max_iops ceph tell osd.0 bench 3072001 1024 2026-02-18T01:25:04.488 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-18T01:25:04.488 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-18T01:25:04.489 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=bench_small_size_max_iops 2026-02-18T01:25:04.489 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-18T01:25:04.489 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-18T01:25:04.489 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3072001 1024 2026-02-18T01:25:04.560 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-18T01:25:04.560 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-18T01:25:04.560 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet bench_small_size_max_iops td/osd-bench/out 2026-02-18T01:25:04.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-18T01:25:04.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:72: TEST_bench: local bsize=1048577 2026-02-18T01:25:04.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:73: TEST_bench: local max_count=3145728000 2026-02-18T01:25:04.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:74: TEST_bench: expect_failure td/osd-bench osd_bench_large_size_max_throughput ceph tell osd.0 bench 3145728001 1048577 2026-02-18T01:25:04.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-18T01:25:04.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-18T01:25:04.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_large_size_max_throughput 2026-02-18T01:25:04.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-18T01:25:04.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-18T01:25:04.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3145728001 1048577 2026-02-18T01:25:04.629 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-18T01:25:04.629 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-18T01:25:04.629 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_large_size_max_throughput td/osd-bench/out 2026-02-18T01:25:04.630 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-18T01:25:04.630 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:80: TEST_bench: ceph tell osd.0 bench 2026-02-18T01:25:06.286 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:25:06.286 INFO:tasks.workunit.client.0.trial080.stdout: "bytes_written": 1073741824, 2026-02-18T01:25:06.286 INFO:tasks.workunit.client.0.trial080.stdout: "blocksize": 4194304, 2026-02-18T01:25:06.286 INFO:tasks.workunit.client.0.trial080.stdout: "elapsed_sec": 0.71333969900000005, 2026-02-18T01:25:06.286 INFO:tasks.workunit.client.0.trial080.stdout: "bytes_per_sec": 1505232115.2253716, 2026-02-18T01:25:06.286 INFO:tasks.workunit.client.0.trial080.stdout: "iops": 358.8753021300725 2026-02-18T01:25:06.287 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:25:06.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:84: TEST_bench: ceph tell osd.0 bench 10 14456 4444 3 2026-02-18T01:25:06.365 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:25:06.366 INFO:tasks.workunit.client.0.trial080.stdout: "bytes_written": 10, 2026-02-18T01:25:06.366 INFO:tasks.workunit.client.0.trial080.stdout: "blocksize": 14456, 2026-02-18T01:25:06.366 INFO:tasks.workunit.client.0.trial080.stdout: "elapsed_sec": 0.00025963000000000001, 2026-02-18T01:25:06.366 INFO:tasks.workunit.client.0.trial080.stdout: "bytes_per_sec": 38516.350190655932, 2026-02-18T01:25:06.366 INFO:tasks.workunit.client.0.trial080.stdout: "iops": 2.6643850436258947 2026-02-18T01:25:06.366 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:25:06.373 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:90: TEST_bench: ceph tell osd.0 bench 1 14456 2026-02-18T01:25:06.440 INFO:tasks.workunit.client.0.trial080.stdout:{ 2026-02-18T01:25:06.440 INFO:tasks.workunit.client.0.trial080.stdout: "bytes_written": 1, 2026-02-18T01:25:06.440 INFO:tasks.workunit.client.0.trial080.stdout: "blocksize": 14456, 2026-02-18T01:25:06.440 INFO:tasks.workunit.client.0.trial080.stdout: "elapsed_sec": 0.00016757999999999999, 2026-02-18T01:25:06.441 INFO:tasks.workunit.client.0.trial080.stdout: "bytes_per_sec": 5967.2992003819072, 2026-02-18T01:25:06.441 INFO:tasks.workunit.client.0.trial080.stdout: "iops": 0.41279048148740366 2026-02-18T01:25:06.441 INFO:tasks.workunit.client.0.trial080.stdout:} 2026-02-18T01:25:06.448 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:35: run: teardown td/osd-bench 2026-02-18T01:25:06.448 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-18T01:25:06.448 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:25:06.448 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-18T01:25:06.449 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:25:06.449 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:25:06.449 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:25:06.449 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:25:06.449 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:25:06.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:25:06.557 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:25:06.557 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:25:06.557 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:25:06.559 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:25:06.559 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:25:06.559 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:25:06.560 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:25:06.560 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:25:06.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:25:06.561 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:25:06.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:25:06.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:25:06.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-18T01:25:06.598 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:25:06.598 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:06.598 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.80914 2026-02-18T01:25:06.598 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.80914 2026-02-18T01:25:06.600 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:25:06.600 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:25:06.600 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T01:25:06.600 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/osd-bench 0 2026-02-18T01:25:06.600 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-18T01:25:06.601 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T01:25:06.601 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-18T01:25:06.601 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:25:06.601 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:25:06.601 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:25:06.601 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:25:06.601 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:25:06.602 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:25:06.602 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:25:06.603 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:25:06.603 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:25:06.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:25:06.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:25:06.605 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:25:06.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:25:06.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:25:06.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:25:06.607 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:25:06.608 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:25:06.609 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T01:25:06.609 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-18T01:25:06.610 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:25:06.610 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:06.610 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.80914 2026-02-18T01:25:06.611 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.80914 2026-02-18T01:25:06.612 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:25:06.612 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:25:06.612 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T01:25:06.613 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T01:25:06.613 DEBUG:teuthology.orchestra.run.trial080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T01:25:06.665 INFO:tasks.workunit:Running workunit osd/osd-bluefs-volume-ops.sh... 2026-02-18T01:25:06.666 DEBUG:teuthology.orchestra.run.trial080:workunit test osd/osd-bluefs-volume-ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2026-02-18T01:25:06.722 INFO:tasks.workunit.client.0.trial080.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T01:25:06.728 INFO:tasks.workunit.client.0.trial080.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T01:25:06.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T01:25:06.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T01:25:06.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T01:25:06.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T01:25:06.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T01:25:06.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T01:25:06.729 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T01:25:06.729 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T01:25:06.729 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/osd-bluefs-volume-ops 2026-02-18T01:25:06.729 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:8: run: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:25:06.729 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:9: run: shift 2026-02-18T01:25:06.729 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: set 2026-02-18T01:25:06.729 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T01:25:06.731 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: local 'funcs=TEST_bluestore 2026-02-18T01:25:06.731 INFO:tasks.workunit.client.0.trial080.stderr:TEST_bluestore2 2026-02-18T01:25:06.731 INFO:tasks.workunit.client.0.trial080.stderr:TEST_bluestore_expand' 2026-02-18T01:25:06.731 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-18T01:25:06.731 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-18T01:25:06.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:25:06.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-18T01:25:06.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:25:06.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:25:06.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-18T01:25:06.732 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:25:06.732 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:25:06.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:25:06.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:25:06.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:25:06.733 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:25:06.733 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:25:06.734 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:25:06.734 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:25:06.735 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:25:06.735 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:25:06.736 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:25:06.737 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:25:06.737 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:25:06.737 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:25:06.737 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:25:06.738 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:25:06.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:25:06.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-18T01:25:06.741 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:25:06.741 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:06.741 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:25:06.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83061 2026-02-18T01:25:06.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:25:06.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:25:06.743 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-18T01:25:06.744 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:25:06.744 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:06.744 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:25:06.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.83061 2026-02-18T01:25:06.745 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:25:06.746 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T01:25:06.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T01:25:06.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:25:06.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-18T01:25:06.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore td/osd-bluefs-volume-ops 2026-02-18T01:25:06.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:20: TEST_bluestore: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:25:06.747 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: ulimit -n 2026-02-18T01:25:06.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: local flimit=4096 2026-02-18T01:25:06.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:23: TEST_bluestore: '[' 4096 -lt 1536 ']' 2026-02-18T01:25:06.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: export CEPH_MON=127.0.0.1:7146 2026-02-18T01:25:06.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: CEPH_MON=127.0.0.1:7146 2026-02-18T01:25:06.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:27: TEST_bluestore: export CEPH_ARGS 2026-02-18T01:25:06.749 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: uuidgen 2026-02-18T01:25:06.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: CEPH_ARGS+='--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none ' 2026-02-18T01:25:06.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:29: TEST_bluestore: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-18T01:25:06.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:30: TEST_bluestore: CEPH_ARGS+='--bluestore_block_size=2147483648 ' 2026-02-18T01:25:06.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:31: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-18T01:25:06.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-18T01:25:06.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:33: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_size=536870912 ' 2026-02-18T01:25:06.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:34: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_create=true ' 2026-02-18T01:25:06.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:35: TEST_bluestore: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-18T01:25:06.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:37: TEST_bluestore: CEPH_ARGS+='--bluestore_allocation_from_file=0 ' 2026-02-18T01:25:06.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:39: TEST_bluestore: run_mon td/osd-bluefs-volume-ops a 2026-02-18T01:25:06.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:25:06.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:25:06.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:25:06.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:25:06.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-18T01:25:06.751 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-18T01:25:06.773 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:25:06.773 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:25:06.773 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:25:06.773 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:25:06.774 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:06.774 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:25:06.774 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:25:06.774 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T01:25:06.801 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:25:06.802 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:25:06.802 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:25:06.802 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:25:06.802 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:25:06.804 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:25:06.804 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:25:06.804 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:25:06.804 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:25:06.804 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:25:06.804 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:06.804 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:25:06.804 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83061/ceph-mon.a.asok 2026-02-18T01:25:06.804 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:25:06.804 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83061/ceph-mon.a.asok config get fsid 2026-02-18T01:25:06.859 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:25:06.859 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:25:06.859 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:25:06.859 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:25:06.859 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:25:06.860 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:25:06.860 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:25:06.860 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:25:06.861 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:25:06.861 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:06.861 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:25:06.861 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83061/ceph-mon.a.asok 2026-02-18T01:25:06.861 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:25:06.861 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83061/ceph-mon.a.asok config get mon_host 2026-02-18T01:25:06.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: run_mgr td/osd-bluefs-volume-ops x 2026-02-18T01:25:06.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:25:06.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:25:06.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T01:25:06.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:25:06.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-18T01:25:06.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:25:07.028 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:25:07.028 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:25:07.028 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:25:07.028 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:25:07.028 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:07.028 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:25:07.028 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:25:07.029 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:25:07.029 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:25:07.051 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:41: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 0 2026-02-18T01:25:07.051 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:25:07.051 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:25:07.051 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:25:07.051 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:25:07.051 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-18T01:25:07.052 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:25:07.052 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:25:07.052 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:25:07.052 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:25:07.052 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-18T01:25:07.052 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-18T01:25:07.052 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:25:07.052 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:25:07.052 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:25:07.052 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:25:07.052 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:25:07.053 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:25:07.054 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:25:07.054 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:25:07.054 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:25:07.054 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:25:07.054 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-18T01:25:07.054 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:25:07.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=781ae022-1823-4474-8be7-16f50f70fddb 2026-02-18T01:25:07.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 781ae022-1823-4474-8be7-16f50f70fddb' 2026-02-18T01:25:07.055 INFO:tasks.workunit.client.0.trial080.stdout:add osd0 781ae022-1823-4474-8be7-16f50f70fddb 2026-02-18T01:25:07.055 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:25:07.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDzFJVpbmlCAxAAxetYMDi9Ek3l+Wf90VZmYw== 2026-02-18T01:25:07.062 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDzFJVpbmlCAxAAxetYMDi9Ek3l+Wf90VZmYw=="}' 2026-02-18T01:25:07.063 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 781ae022-1823-4474-8be7-16f50f70fddb -i td/osd-bluefs-volume-ops/0/new.json 2026-02-18T01:25:07.173 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:25:07.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-18T01:25:07.182 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDzFJVpbmlCAxAAxetYMDi9Ek3l+Wf90VZmYw== --osd-uuid 781ae022-1823-4474-8be7-16f50f70fddb 2026-02-18T01:25:07.197 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:07.189+0000 7f44cba2da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:07.199 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:07.189+0000 7f44cba2da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:07.200 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:07.189+0000 7f44cba2da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:07.200 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:07.189+0000 7f44cba2da40 -1 bdev(0x558cf4a14c00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:25:07.200 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:07.189+0000 7f44cba2da40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-18T01:25:09.102 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-18T01:25:09.102 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:25:09.103 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:25:09.103 INFO:tasks.workunit.client.0.trial080.stdout:adding osd0 key to auth repository 2026-02-18T01:25:09.103 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:25:09.253 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:25:09.254 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:25:09.254 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:25:09.254 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:25:09.254 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:25:09.254 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:25:09.274 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:09.265+0000 7fcb68c86a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:09.275 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:09.265+0000 7fcb68c86a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:09.276 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:09.265+0000 7fcb68c86a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:09.361 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:25:09.361 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:25:09.361 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:25:09.362 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:25:09.362 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:25:09.362 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:09.362 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:25:09.363 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:25:09.363 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:09.363 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:25:09.573 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:25:09.735 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:09.725+0000 7fcb68c86a40 -1 Falling back to public interface 2026-02-18T01:25:10.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:25:10.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:10.576 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:25:10.576 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:25:10.576 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:10.576 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:25:10.790 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:25:11.049 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:11.037+0000 7fcb68c86a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:25:11.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:25:11.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:11.792 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:25:11.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:25:11.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:11.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:25:12.012 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3432554427,v1:127.0.0.1:6803/3432554427] [v2:127.0.0.1:6804/3432554427,v1:127.0.0.1:6805/3432554427] exists,up 781ae022-1823-4474-8be7-16f50f70fddb 2026-02-18T01:25:12.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:25:12.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:25:12.013 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:25:12.013 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-18T01:25:12.017 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: osd_pid0=84475 2026-02-18T01:25:12.017 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:43: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 1 2026-02-18T01:25:12.017 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:25:12.017 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:25:12.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T01:25:12.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:25:12.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-18T01:25:12.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:25:12.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:25:12.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:25:12.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:25:12.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-18T01:25:12.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-18T01:25:12.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:25:12.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:25:12.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:25:12.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:25:12.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:25:12.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:25:12.019 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:25:12.019 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:12.019 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:25:12.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:25:12.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:25:12.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:25:12.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:25:12.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:25:12.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:25:12.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:25:12.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:25:12.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:25:12.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:25:12.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:25:12.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:25:12.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:25:12.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-18T01:25:12.020 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:25:12.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4e7312bd-4178-444f-9144-f60248cf99ab 2026-02-18T01:25:12.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 4e7312bd-4178-444f-9144-f60248cf99ab' 2026-02-18T01:25:12.022 INFO:tasks.workunit.client.0.trial080.stdout:add osd1 4e7312bd-4178-444f-9144-f60248cf99ab 2026-02-18T01:25:12.022 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:25:12.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD4FJVpAWtVARAAfkYjvk+pd8iPzmlg4bS/6Q== 2026-02-18T01:25:12.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD4FJVpAWtVARAAfkYjvk+pd8iPzmlg4bS/6Q=="}' 2026-02-18T01:25:12.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4e7312bd-4178-444f-9144-f60248cf99ab -i td/osd-bluefs-volume-ops/1/new.json 2026-02-18T01:25:12.236 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:25:12.246 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/1/new.json 2026-02-18T01:25:12.246 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD4FJVpAWtVARAAfkYjvk+pd8iPzmlg4bS/6Q== --osd-uuid 4e7312bd-4178-444f-9144-f60248cf99ab 2026-02-18T01:25:12.262 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:12.253+0000 7f5ce74cea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:12.264 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:12.253+0000 7f5ce74cea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:12.265 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:12.253+0000 7f5ce74cea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:12.266 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:12.253+0000 7f5ce74cea40 -1 bdev(0x5610c8200c00 td/osd-bluefs-volume-ops/1/block) open stat got: (1) Operation not permitted 2026-02-18T01:25:12.266 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:12.257+0000 7f5ce74cea40 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_fsid unparsable uuid 2026-02-18T01:25:13.824 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/1/keyring 2026-02-18T01:25:13.824 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:25:13.825 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T01:25:13.825 INFO:tasks.workunit.client.0.trial080.stdout:adding osd1 key to auth repository 2026-02-18T01:25:13.826 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:25:14.123 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:25:14.124 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T01:25:14.124 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:25:14.124 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:25:14.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:25:14.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:25:14.139 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:14.128+0000 7efcba901a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:14.140 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:14.128+0000 7efcba901a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:14.141 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:14.128+0000 7efcba901a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:14.335 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T01:25:14.336 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:25:14.336 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:25:14.336 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:25:14.336 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:25:14.336 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:14.336 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:25:14.336 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:25:14.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:14.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:25:14.539 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:25:14.671 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:14.660+0000 7efcba901a40 -1 Falling back to public interface 2026-02-18T01:25:15.540 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:25:15.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:15.541 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:25:15.542 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:25:15.542 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:15.542 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:25:15.746 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:25:15.973 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:15.960+0000 7efcba901a40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:25:16.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:25:16.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:16.748 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:25:16.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:25:16.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:16.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:25:16.957 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3789554610,v1:127.0.0.1:6811/3789554610] [v2:127.0.0.1:6812/3789554610,v1:127.0.0.1:6813/3789554610] exists,up 4e7312bd-4178-444f-9144-f60248cf99ab 2026-02-18T01:25:16.957 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:25:16.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:25:16.958 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:25:16.958 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-18T01:25:16.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: osd_pid1=86866 2026-02-18T01:25:16.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:45: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 2 2026-02-18T01:25:16.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:25:16.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:25:16.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T01:25:16.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:25:16.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-18T01:25:16.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:25:16.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:25:16.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:25:16.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:25:16.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-18T01:25:16.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-18T01:25:16.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:25:16.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:25:16.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:25:16.963 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:25:16.963 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:25:16.963 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:25:16.963 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:25:16.963 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:16.963 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:25:16.963 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:25:16.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:25:16.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:25:16.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:25:16.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:25:16.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:25:16.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:25:16.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:25:16.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:25:16.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:25:16.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:25:16.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:25:16.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:25:16.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-18T01:25:16.965 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:25:16.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=91c2b4fc-ad3a-4c6d-9200-c3a566760b4d 2026-02-18T01:25:16.966 INFO:tasks.workunit.client.0.trial080.stdout:add osd2 91c2b4fc-ad3a-4c6d-9200-c3a566760b4d 2026-02-18T01:25:16.966 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 91c2b4fc-ad3a-4c6d-9200-c3a566760b4d' 2026-02-18T01:25:16.966 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:25:16.973 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD8FJVpx/SJORAADFQ6Bf9lNjbRD0cQs+TypA== 2026-02-18T01:25:16.973 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD8FJVpx/SJORAADFQ6Bf9lNjbRD0cQs+TypA=="}' 2026-02-18T01:25:16.973 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 91c2b4fc-ad3a-4c6d-9200-c3a566760b4d -i td/osd-bluefs-volume-ops/2/new.json 2026-02-18T01:25:17.192 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:25:17.202 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/2/new.json 2026-02-18T01:25:17.204 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD8FJVpx/SJORAADFQ6Bf9lNjbRD0cQs+TypA== --osd-uuid 91c2b4fc-ad3a-4c6d-9200-c3a566760b4d 2026-02-18T01:25:17.227 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:17.216+0000 7f74d1e4ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:17.229 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:17.216+0000 7f74d1e4ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:17.230 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:17.220+0000 7f74d1e4ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:17.230 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:17.220+0000 7f74d1e4ba40 -1 bdev(0x55ea316eac00 td/osd-bluefs-volume-ops/2/block) open stat got: (1) Operation not permitted 2026-02-18T01:25:17.231 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:17.220+0000 7f74d1e4ba40 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_fsid unparsable uuid 2026-02-18T01:25:18.661 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/2/keyring 2026-02-18T01:25:18.661 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:25:18.662 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T01:25:18.662 INFO:tasks.workunit.client.0.trial080.stdout:adding osd2 key to auth repository 2026-02-18T01:25:18.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:25:18.956 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T01:25:18.956 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:25:18.957 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:25:18.957 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:25:18.957 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:25:18.957 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:25:18.979 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:18.968+0000 7fe308f9ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:18.981 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:18.968+0000 7fe308f9ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:18.982 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:18.972+0000 7fe308f9ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:19.163 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T01:25:19.164 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:25:19.164 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:25:19.164 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:25:19.164 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:25:19.164 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:19.164 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:25:19.164 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:25:19.165 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:19.165 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:25:19.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:25:19.479 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:19.468+0000 7fe308f9ba40 -1 Falling back to public interface 2026-02-18T01:25:20.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:25:20.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:20.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:25:20.377 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:25:20.378 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:20.378 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:25:20.562 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:20.552+0000 7fe308f9ba40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:25:20.583 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:25:21.584 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:25:21.584 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:21.585 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:25:21.585 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:25:21.585 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:21.585 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:25:21.795 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1692209553,v1:127.0.0.1:6819/1692209553] [v2:127.0.0.1:6820/1692209553,v1:127.0.0.1:6821/1692209553] exists,up 91c2b4fc-ad3a-4c6d-9200-c3a566760b4d 2026-02-18T01:25:21.795 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:25:21.795 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:25:21.795 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:25:21.796 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-18T01:25:21.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: osd_pid2=89057 2026-02-18T01:25:21.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:47: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 3 2026-02-18T01:25:21.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:25:21.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:25:21.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T01:25:21.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:25:21.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-18T01:25:21.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:25:21.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:25:21.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:25:21.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:25:21.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-18T01:25:21.799 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-18T01:25:21.799 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:25:21.799 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:25:21.799 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:25:21.799 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:25:21.799 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:25:21.799 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:25:21.801 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:25:21.801 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:25:21.801 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:25:21.801 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:25:21.801 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:25:21.801 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:25:21.801 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:25:21.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:25:21.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:25:21.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:25:21.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:25:21.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:25:21.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:25:21.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:25:21.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:25:21.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:25:21.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-18T01:25:21.802 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:25:21.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e11cd4c1-314c-49a7-9483-993c12116f51 2026-02-18T01:25:21.803 INFO:tasks.workunit.client.0.trial080.stdout:add osd3 e11cd4c1-314c-49a7-9483-993c12116f51 2026-02-18T01:25:21.803 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 e11cd4c1-314c-49a7-9483-993c12116f51' 2026-02-18T01:25:21.803 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:25:21.812 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQABFZVpx1P0LxAAXRXTTMm+ho9eCFoPMaHNnQ== 2026-02-18T01:25:21.812 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQABFZVpx1P0LxAAXRXTTMm+ho9eCFoPMaHNnQ=="}' 2026-02-18T01:25:21.813 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e11cd4c1-314c-49a7-9483-993c12116f51 -i td/osd-bluefs-volume-ops/3/new.json 2026-02-18T01:25:22.027 INFO:tasks.workunit.client.0.trial080.stdout:3 2026-02-18T01:25:22.037 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/3/new.json 2026-02-18T01:25:22.038 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQABFZVpx1P0LxAAXRXTTMm+ho9eCFoPMaHNnQ== --osd-uuid e11cd4c1-314c-49a7-9483-993c12116f51 2026-02-18T01:25:22.053 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:22.040+0000 7fee24a1fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:22.055 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:22.044+0000 7fee24a1fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:22.056 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:22.044+0000 7fee24a1fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:22.056 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:22.044+0000 7fee24a1fa40 -1 bdev(0x55613aba4c00 td/osd-bluefs-volume-ops/3/block) open stat got: (1) Operation not permitted 2026-02-18T01:25:22.057 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:22.044+0000 7fee24a1fa40 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_fsid unparsable uuid 2026-02-18T01:25:23.495 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/3/keyring 2026-02-18T01:25:23.495 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:25:23.496 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T01:25:23.496 INFO:tasks.workunit.client.0.trial080.stdout:adding osd3 key to auth repository 2026-02-18T01:25:23.497 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:25:23.786 INFO:tasks.workunit.client.0.trial080.stdout:start osd.3 2026-02-18T01:25:23.787 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T01:25:23.787 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:25:23.788 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:25:23.788 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:25:23.788 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:25:23.809 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:23.796+0000 7f4629f13a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:23.811 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:23.800+0000 7f4629f13a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:23.812 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:23.800+0000 7f4629f13a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:25:24.000 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T01:25:24.000 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:25:24.000 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T01:25:24.001 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:25:24.001 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:25:24.001 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:24.001 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:25:24.002 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:25:24.002 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:24.002 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:25:24.213 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:25:24.311 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:24.300+0000 7f4629f13a40 -1 Falling back to public interface 2026-02-18T01:25:25.214 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:25:25.214 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:25.215 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:25:25.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:25:25.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:25.216 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:25:25.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:25:25.575 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:25:25.564+0000 7f4629f13a40 -1 osd.3 0 log_to_monitors true 2026-02-18T01:25:26.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:25:26.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:25:26.427 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:25:26.427 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:25:26.427 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:25:26.428 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:25:26.632 INFO:tasks.workunit.client.0.trial080.stdout:osd.3 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/284468530,v1:127.0.0.1:6827/284468530] [v2:127.0.0.1:6828/284468530,v1:127.0.0.1:6829/284468530] exists,up e11cd4c1-314c-49a7-9483-993c12116f51 2026-02-18T01:25:26.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:25:26.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:25:26.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:25:26.633 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-18T01:25:26.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: osd_pid3=91209 2026-02-18T01:25:26.634 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:50: TEST_bluestore: sleep 5 2026-02-18T01:25:31.635 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:52: TEST_bluestore: create_pool foo 16 2026-02-18T01:25:31.635 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-18T01:25:31.890 INFO:tasks.workunit.client.0.trial080.stderr:pool 'foo' already exists 2026-02-18T01:25:31.900 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T01:25:32.902 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:55: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-18T01:25:32.922 INFO:tasks.workunit.client.0.trial080.stdout:hints = 1 2026-02-18T01:25:32.923 INFO:tasks.workunit.client.0.trial080.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-18T01:25:32.923 INFO:tasks.workunit.client.0.trial080.stdout:Object prefix: benchmark_data_trial080_92176 2026-02-18T01:25:32.923 INFO:tasks.workunit.client.0.trial080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T01:25:32.923 INFO:tasks.workunit.client.0.trial080.stdout: 0 0 0 0 0 0 - 0 2026-02-18T01:25:33.922 INFO:tasks.workunit.client.0.trial080.stdout: 1 15 10732 10717 41.8602 41.8633 0.00111754 0.00149031 2026-02-18T01:25:34.923 INFO:tasks.workunit.client.0.trial080.stdout: 2 15 21454 21439 41.8698 41.8828 0.00153874 0.00149082 2026-02-18T01:25:35.923 INFO:tasks.workunit.client.0.trial080.stdout: 3 16 32421 32405 42.1908 42.8359 0.000887663 0.00147956 2026-02-18T01:25:36.923 INFO:tasks.workunit.client.0.trial080.stdout: 4 16 43156 43140 42.1255 41.9336 0.00108073 0.00148198 2026-02-18T01:25:37.923 INFO:tasks.workunit.client.0.trial080.stdout: 5 16 53943 53927 42.1271 42.1367 0.00123039 0.00148197 2026-02-18T01:25:38.923 INFO:tasks.workunit.client.0.trial080.stdout: 6 16 62133 62117 40.4376 31.9922 0.00123906 0.00154399 2026-02-18T01:25:39.923 INFO:tasks.workunit.client.0.trial080.stdout: 7 16 72981 72965 40.7139 42.375 0.00180501 0.00153346 2026-02-18T01:25:40.923 INFO:tasks.workunit.client.0.trial080.stdout: 8 16 83542 83526 40.781 41.2539 0.00159108 0.00153098 2026-02-18T01:25:41.924 INFO:tasks.workunit.client.0.trial080.stdout: 9 16 94586 94570 41.0428 43.1406 0.00138558 0.00152118 2026-02-18T01:25:42.923 INFO:tasks.workunit.client.0.trial080.stdout: 10 16 105393 105377 41.1597 42.2148 0.00130984 0.00151695 2026-02-18T01:25:43.924 INFO:tasks.workunit.client.0.trial080.stdout: 11 16 111090 111074 39.4408 22.2539 0.108668 0.00157541 2026-02-18T01:25:44.924 INFO:tasks.workunit.client.0.trial080.stdout: 12 15 112326 112311 36.5567 4.83203 0.00190205 0.00170811 2026-02-18T01:25:45.924 INFO:tasks.workunit.client.0.trial080.stdout: 13 16 123224 123208 37.0188 42.5664 0.00132667 0.00168679 2026-02-18T01:25:46.924 INFO:tasks.workunit.client.0.trial080.stdout: 14 16 134049 134033 37.3947 42.2852 0.00178967 0.00166983 2026-02-18T01:25:47.924 INFO:tasks.workunit.client.0.trial080.stdout: 15 16 143865 143849 37.4578 38.3438 0.00140898 0.00166702 2026-02-18T01:25:48.924 INFO:tasks.workunit.client.0.trial080.stdout: 16 16 153577 153561 37.4876 37.9375 0.00109225 0.00166571 2026-02-18T01:25:49.924 INFO:tasks.workunit.client.0.trial080.stdout: 17 16 162100 162084 37.2407 33.293 0.0632453 0.001671 2026-02-18T01:25:50.924 INFO:tasks.workunit.client.0.trial080.stdout: 18 16 163206 163190 35.4118 4.32031 0.0015167 0.00176344 2026-02-18T01:25:51.924 INFO:tasks.workunit.client.0.trial080.stdout: 19 15 172410 172395 35.4403 35.957 0.00161986 0.00176203 2026-02-18T01:25:52.925 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:25:52.916793+0000 min lat: 0.000463618 max lat: 0.194396 avg lat: 0.00175933 2026-02-18T01:25:52.925 INFO:tasks.workunit.client.0.trial080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T01:25:52.925 INFO:tasks.workunit.client.0.trial080.stdout: 20 16 181761 181745 35.4943 36.5234 0.00142427 0.00175933 2026-02-18T01:25:53.924 INFO:tasks.workunit.client.0.trial080.stdout: 21 16 191001 190985 35.5227 36.0938 0.00183401 0.0017579 2026-02-18T01:25:54.935 INFO:tasks.workunit.client.0.trial080.stdout: 22 16 200051 200035 35.5148 35.3516 0.00172706 0.00175829 2026-02-18T01:25:55.925 INFO:tasks.workunit.client.0.trial080.stdout: 23 16 209378 209362 35.5546 36.4336 0.00161286 0.00175636 2026-02-18T01:25:56.925 INFO:tasks.workunit.client.0.trial080.stdout: 24 16 209932 209916 34.1633 2.16406 0.128779 0.00182134 2026-02-18T01:25:57.925 INFO:tasks.workunit.client.0.trial080.stdout: 25 16 210080 210064 32.8199 0.578125 0.125082 0.00190109 2026-02-18T01:25:58.925 INFO:tasks.workunit.client.0.trial080.stdout: 26 16 219123 219107 32.9162 35.3242 0.00164098 0.00189726 2026-02-18T01:25:59.925 INFO:tasks.workunit.client.0.trial080.stdout: 27 16 228349 228333 33.0317 36.0391 0.00149224 0.00189063 2026-02-18T01:26:00.925 INFO:tasks.workunit.client.0.trial080.stdout: 28 16 237454 237438 33.1221 35.5664 0.00167691 0.00188545 2026-02-18T01:26:01.925 INFO:tasks.workunit.client.0.trial080.stdout: 29 16 246759 246743 33.2333 36.3477 0.00191805 0.00187915 2026-02-18T01:26:02.926 INFO:tasks.workunit.client.0.trial080.stdout:Total time run: 30.0011 2026-02-18T01:26:02.926 INFO:tasks.workunit.client.0.trial080.stdout:Total writes made: 256024 2026-02-18T01:26:02.926 INFO:tasks.workunit.client.0.trial080.stdout:Write size: 4096 2026-02-18T01:26:02.926 INFO:tasks.workunit.client.0.trial080.stdout:Object size: 4096 2026-02-18T01:26:02.926 INFO:tasks.workunit.client.0.trial080.stdout:Bandwidth (MB/sec): 33.3353 2026-02-18T01:26:02.926 INFO:tasks.workunit.client.0.trial080.stdout:Stddev Bandwidth: 13.1004 2026-02-18T01:26:02.927 INFO:tasks.workunit.client.0.trial080.stdout:Max bandwidth (MB/sec): 43.1406 2026-02-18T01:26:02.927 INFO:tasks.workunit.client.0.trial080.stdout:Min bandwidth (MB/sec): 0.578125 2026-02-18T01:26:02.927 INFO:tasks.workunit.client.0.trial080.stdout:Average IOPS: 8533 2026-02-18T01:26:02.927 INFO:tasks.workunit.client.0.trial080.stdout:Stddev IOPS: 3353.7 2026-02-18T01:26:02.927 INFO:tasks.workunit.client.0.trial080.stdout:Max IOPS: 11044 2026-02-18T01:26:02.927 INFO:tasks.workunit.client.0.trial080.stdout:Min IOPS: 148 2026-02-18T01:26:02.927 INFO:tasks.workunit.client.0.trial080.stdout:Average Latency(s): 0.00187343 2026-02-18T01:26:02.927 INFO:tasks.workunit.client.0.trial080.stdout:Stddev Latency(s): 0.00556068 2026-02-18T01:26:02.927 INFO:tasks.workunit.client.0.trial080.stdout:Max latency(s): 0.261521 2026-02-18T01:26:02.927 INFO:tasks.workunit.client.0.trial080.stdout:Min latency(s): 0.000463618 2026-02-18T01:26:02.929 INFO:tasks.workunit.client.0.trial080.stdout:after bench 2026-02-18T01:26:02.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:57: TEST_bluestore: echo 'after bench' 2026-02-18T01:26:02.929 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 84475 2026-02-18T01:26:02.930 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2026-02-18T01:26:03.930 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 84475 2026-02-18T01:26:03.931 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 60: kill: (84475) - No such process 2026-02-18T01:26:03.931 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:61: TEST_bluestore: ceph osd down 0 2026-02-18T01:26:04.142 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already down. 2026-02-18T01:26:04.151 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 86866 2026-02-18T01:26:04.152 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2026-02-18T01:26:05.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 86866 2026-02-18T01:26:05.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 62: kill: (86866) - No such process 2026-02-18T01:26:05.153 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:63: TEST_bluestore: ceph osd down 1 2026-02-18T01:26:05.363 INFO:tasks.workunit.client.0.trial080.stderr:osd.1 is already down. 2026-02-18T01:26:05.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 89057 2026-02-18T01:26:05.374 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2026-02-18T01:26:06.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 89057 2026-02-18T01:26:06.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 64: kill: (89057) - No such process 2026-02-18T01:26:06.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:65: TEST_bluestore: ceph osd down 2 2026-02-18T01:26:06.592 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already down. 2026-02-18T01:26:06.602 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 91209 2026-02-18T01:26:06.602 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: sleep 1 2026-02-18T01:26:07.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 91209 2026-02-18T01:26:07.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 66: kill: (91209) - No such process 2026-02-18T01:26:07.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:67: TEST_bluestore: ceph osd down 3 2026-02-18T01:26:07.873 INFO:tasks.workunit.client.0.trial080.stderr:osd.3 is already down. 2026-02-18T01:26:07.883 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:70: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-18T01:26:11.959 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:26:11.998 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:71: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-18T01:26:16.139 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:26:16.178 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:72: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-18T01:26:20.251 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:26:20.279 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:73: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-18T01:26:24.339 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:26:24.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:75: TEST_bluestore: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-18T01:26:24.379 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-18T01:26:24.396 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:26:27.852 INFO:tasks.workunit.client.0.trial080.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-18T01:26:27.853 INFO:tasks.workunit.client.0.trial080.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-18T01:26:27.853 INFO:tasks.workunit.client.0.trial080.stdout:2 : device size 0x100000000(4 GiB) : using 0xaeda1000(2.7 GiB) 2026-02-18T01:26:27.853 INFO:tasks.workunit.client.0.trial080.stdout:Expanding DB/WAL... 2026-02-18T01:26:27.853 INFO:tasks.workunit.client.0.trial080.stdout:0 : nothing to do, skipped 2026-02-18T01:26:27.853 INFO:tasks.workunit.client.0.trial080.stdout:1 : nothing to do, skipped 2026-02-18T01:26:27.853 INFO:tasks.workunit.client.0.trial080.stdout:2 : Expanding to 0x100000000(4 GiB) 2026-02-18T01:26:27.854 INFO:tasks.workunit.client.0.trial080.stdout:2 : size updated to 0x100000000(4 GiB) 2026-02-18T01:26:31.553 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:77: TEST_bluestore: truncate td/osd-bluefs-volume-ops/1/block -s 11811160064 2026-02-18T01:26:31.554 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:78: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 bluefs-bdev-expand 2026-02-18T01:26:31.573 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:26:34.991 INFO:tasks.workunit.client.0.trial080.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-18T01:26:34.991 INFO:tasks.workunit.client.0.trial080.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-18T01:26:34.991 INFO:tasks.workunit.client.0.trial080.stdout:2 : device size 0x2c0000000(11 GiB) : using 0x26ee9d000(9.7 GiB) 2026-02-18T01:26:34.991 INFO:tasks.workunit.client.0.trial080.stdout:Expanding DB/WAL... 2026-02-18T01:26:34.991 INFO:tasks.workunit.client.0.trial080.stdout:0 : nothing to do, skipped 2026-02-18T01:26:34.991 INFO:tasks.workunit.client.0.trial080.stdout:1 : nothing to do, skipped 2026-02-18T01:26:34.991 INFO:tasks.workunit.client.0.trial080.stdout:2 : Expanding to 0x2c0000000(11 GiB) 2026-02-18T01:26:34.992 INFO:tasks.workunit.client.0.trial080.stdout:2 : size updated to 0x2c0000000(11 GiB) 2026-02-18T01:26:38.666 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:79: TEST_bluestore: truncate td/osd-bluefs-volume-ops/2/block -s 4295099392 2026-02-18T01:26:38.667 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:80: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 bluefs-bdev-expand 2026-02-18T01:26:38.685 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:26:42.148 INFO:tasks.workunit.client.0.trial080.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-18T01:26:42.148 INFO:tasks.workunit.client.0.trial080.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-18T01:26:42.149 INFO:tasks.workunit.client.0.trial080.stdout:2 : device size 0x100020000(4.0 GiB) : using 0xaee7f000(2.7 GiB) 2026-02-18T01:26:42.149 INFO:tasks.workunit.client.0.trial080.stdout:Expanding DB/WAL... 2026-02-18T01:26:42.149 INFO:tasks.workunit.client.0.trial080.stdout:0 : nothing to do, skipped 2026-02-18T01:26:42.149 INFO:tasks.workunit.client.0.trial080.stdout:1 : nothing to do, skipped 2026-02-18T01:26:42.149 INFO:tasks.workunit.client.0.trial080.stdout:2 : Expanding to 0x100020000(4.0 GiB) 2026-02-18T01:26:42.149 INFO:tasks.workunit.client.0.trial080.stdout:2 : size updated to 0x100020000(4.0 GiB) 2026-02-18T01:26:45.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:81: TEST_bluestore: truncate td/osd-bluefs-volume-ops/3/block -s 4293918720 2026-02-18T01:26:45.888 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:82: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 bluefs-bdev-expand 2026-02-18T01:26:45.907 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:26:49.282 INFO:tasks.workunit.client.0.trial080.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-18T01:26:49.282 INFO:tasks.workunit.client.0.trial080.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-18T01:26:49.282 INFO:tasks.workunit.client.0.trial080.stdout:2 : device size 0xfff00000(4.0 GiB) : using 0xaed84000(2.7 GiB) 2026-02-18T01:26:49.282 INFO:tasks.workunit.client.0.trial080.stdout:Expanding DB/WAL... 2026-02-18T01:26:49.283 INFO:tasks.workunit.client.0.trial080.stdout:0 : nothing to do, skipped 2026-02-18T01:26:49.283 INFO:tasks.workunit.client.0.trial080.stdout:1 : nothing to do, skipped 2026-02-18T01:26:49.283 INFO:tasks.workunit.client.0.trial080.stdout:2 : Expanding to 0xfff00000(4.0 GiB) 2026-02-18T01:26:49.283 INFO:tasks.workunit.client.0.trial080.stdout:2 : size updated to 0xfff00000(4.0 GiB) 2026-02-18T01:26:53.046 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:85: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-18T01:26:53.920 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:26:53.956 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:86: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-18T01:26:54.828 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:26:54.866 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:87: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-18T01:26:55.736 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:26:55.774 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:88: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-18T01:26:56.648 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:26:56.685 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:90: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-18T01:26:56.704 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:26:56.896 INFO:tasks.workunit.client.0.trial080.stdout:0 : device size 0x20000000(512 MiB) : using 0x500000(5 MiB) 2026-02-18T01:26:56.896 INFO:tasks.workunit.client.0.trial080.stdout:1 : device size 0x40000000(1 GiB) : using 0x4100000(65 MiB) 2026-02-18T01:26:56.896 INFO:tasks.workunit.client.0.trial080.stdout:2 : device size 0x100000000(4 GiB) : using 0x2eda1000(750 MiB) 2026-02-18T01:26:57.072 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:92: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/block.db --command bluefs-bdev-migrate 2026-02-18T01:26:57.085 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:26:57.660 INFO:tasks.workunit.client.0.trial080.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-18T01:26:57.663 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:97: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-18T01:26:58.480 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:26:58.509 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:100: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-18T01:26:58.526 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:26:59.132 INFO:tasks.workunit.client.0.trial080.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-18T01:26:59.137 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:105: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-18T01:26:59.984 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:27:00.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:108: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block.wal --devs-source td/osd-bluefs-volume-ops/2/block.db --dev-target td/osd-bluefs-volume-ops/2/block --command bluefs-bdev-migrate 2026-02-18T01:27:00.040 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:27:00.708 INFO:tasks.workunit.client.0.trial080.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-18T01:27:00.708 INFO:tasks.workunit.client.0.trial080.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-18T01:27:00.712 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:114: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-18T01:27:01.464 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:27:01.492 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:117: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block.wal --command bluefs-bdev-migrate 2026-02-18T01:27:01.510 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:27:01.632 INFO:tasks.workunit.client.0.trial080.stderr:Migrate to WAL device isn't supported. 2026-02-18T01:27:01.634 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:123: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-18T01:27:01.634 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:126: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-18T01:27:02.540 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:27:02.577 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:129: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-18T01:27:02.596 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:27:03.176 INFO:tasks.workunit.client.0.trial080.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-18T01:27:03.179 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:134: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-18T01:27:03.992 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:27:04.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:136: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --dev-target td/osd-bluefs-volume-ops/3/block.db --command bluefs-bdev-migrate 2026-02-18T01:27:04.038 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:27:04.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:141: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-18T01:27:05.260 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:27:05.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:143: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-18T01:27:05.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:27:05.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:27:05.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:27:05.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:27:05.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-18T01:27:05.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:27:05.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:27:05.299 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:27:05.300 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:27:05.302 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:27:05.302 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:27:05.302 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:27:05.302 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:27:05.302 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:27:05.302 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:27:05.302 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:27:05.302 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:27:05.303 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:27:05.303 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:27:05.303 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-18T01:27:05.303 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:27:05.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:27:05.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:27:05.304 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-18T01:27:05.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:27:05.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:27:05.304 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:27:05.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:27:05.321 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:05.310+0000 7f9a1ced3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:27:05.323 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:05.310+0000 7f9a1ced3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:27:05.324 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:05.314+0000 7f9a1ced3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:27:05.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:27:05.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:27:05.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:27:05.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:27:05.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:27:05.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:27:05.518 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:27:05.519 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:27:05.519 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:27:05.519 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:27:05.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:27:05.829 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:05.818+0000 7f9a1ced3a40 -1 Falling back to public interface 2026-02-18T01:27:06.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:27:06.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:27:06.741 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:27:06.742 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:27:06.742 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:27:06.742 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:27:06.951 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:27:07.730 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:07.718+0000 7f9a1ced3a40 -1 osd.0 22 log_to_monitors true 2026-02-18T01:27:07.952 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:27:07.953 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:27:07.953 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:27:07.954 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:27:07.954 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:27:07.954 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:27:08.164 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 30 up_thru 30 down_at 22 last_clean_interval [5,22) [v2:127.0.0.1:6802/3649611095,v1:127.0.0.1:6803/3649611095] [v2:127.0.0.1:6804/3649611095,v1:127.0.0.1:6805/3649611095] exists,up 781ae022-1823-4474-8be7-16f50f70fddb 2026-02-18T01:27:08.164 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:27:08.165 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:27:08.165 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:27:08.165 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-18T01:27:08.168 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: osd_pid0=102830 2026-02-18T01:27:08.168 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:145: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-18T01:27:08.168 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:27:08.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:27:08.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:27:08.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:27:08.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-18T01:27:08.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:27:08.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:27:08.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:27:08.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:27:08.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-18T01:27:08.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-18T01:27:08.169 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:27:08.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:27:08.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:27:08.170 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:27:08.170 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:27:08.170 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:27:08.170 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:27:08.170 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:27:08.170 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:27:08.170 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:27:08.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:27:08.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:27:08.170 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:27:08.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:27:08.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:27:08.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:27:08.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:27:08.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:27:08.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:27:08.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:27:08.171 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-18T01:27:08.172 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:27:08.173 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:27:08.173 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:27:08.173 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-18T01:27:08.173 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:27:08.173 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:27:08.173 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:27:08.173 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:27:08.188 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:08.174+0000 7f418d45ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:27:08.189 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:08.178+0000 7f418d45ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:27:08.190 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:08.178+0000 7f418d45ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:27:08.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T01:27:08.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:27:08.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:27:08.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:27:08.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:27:08.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:27:08.383 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:27:08.383 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:27:08.383 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:27:08.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:27:08.589 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:27:08.634 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:08.622+0000 7f418d45ea40 -1 Falling back to public interface 2026-02-18T01:27:09.590 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:27:09.591 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:27:09.591 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:27:09.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:27:09.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:27:09.592 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:27:09.807 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:27:10.472 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:10.458+0000 7f418d45ea40 -1 osd.1 23 log_to_monitors true 2026-02-18T01:27:10.809 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:27:10.809 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:27:10.809 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:27:10.810 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:27:10.810 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:27:10.810 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:27:11.017 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 34 up_thru 34 down_at 24 last_clean_interval [9,23) [v2:127.0.0.1:6810/2823236153,v1:127.0.0.1:6811/2823236153] [v2:127.0.0.1:6812/2823236153,v1:127.0.0.1:6813/2823236153] exists,up 4e7312bd-4178-444f-9144-f60248cf99ab 2026-02-18T01:27:11.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:27:11.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:27:11.018 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:27:11.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-18T01:27:11.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: osd_pid1=103771 2026-02-18T01:27:11.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:147: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-18T01:27:11.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:27:11.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:27:11.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T01:27:11.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:27:11.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-18T01:27:11.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:27:11.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:27:11.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:27:11.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:27:11.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-18T01:27:11.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-18T01:27:11.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:27:11.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:27:11.022 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:27:11.022 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:27:11.022 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:27:11.022 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:27:11.023 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:27:11.023 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:27:11.023 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:27:11.023 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:27:11.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:27:11.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:27:11.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:27:11.024 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:27:11.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:27:11.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:27:11.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:27:11.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:27:11.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:27:11.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:27:11.025 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-18T01:27:11.025 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:27:11.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T01:27:11.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:27:11.027 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-18T01:27:11.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T01:27:11.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:27:11.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:27:11.027 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:27:11.041 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:11.029+0000 7fa2ca7ffa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:27:11.042 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:11.029+0000 7fa2ca7ffa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:27:11.043 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:11.029+0000 7fa2ca7ffa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:27:11.234 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T01:27:11.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:27:11.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:27:11.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:27:11.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:27:11.235 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:27:11.235 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:27:11.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:27:11.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:27:11.236 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:27:11.452 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:27:11.470 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:11.457+0000 7fa2ca7ffa40 -1 Falling back to public interface 2026-02-18T01:27:12.454 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:27:12.454 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:27:12.454 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:27:12.455 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:27:12.455 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:27:12.455 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:27:12.665 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:27:13.120 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:13.105+0000 7fa2ca7ffa40 -1 osd.2 25 log_to_monitors true 2026-02-18T01:27:13.666 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:27:13.667 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:27:13.667 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:27:13.668 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:27:13.668 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:27:13.668 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:27:13.880 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 38 up_thru 38 down_at 26 last_clean_interval [13,25) [v2:127.0.0.1:6818/3164366029,v1:127.0.0.1:6819/3164366029] [v2:127.0.0.1:6820/3164366029,v1:127.0.0.1:6821/3164366029] exists,up 91c2b4fc-ad3a-4c6d-9200-c3a566760b4d 2026-02-18T01:27:13.881 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:27:13.881 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:27:13.881 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:27:13.881 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-18T01:27:13.884 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: osd_pid2=104712 2026-02-18T01:27:13.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:149: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-18T01:27:13.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:27:13.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:27:13.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-18T01:27:13.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:27:13.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-18T01:27:13.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:27:13.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:27:13.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:27:13.885 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:27:13.886 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:27:13.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:27:13.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:27:13.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:27:13.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:27:13.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:27:13.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:27:13.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:27:13.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:27:13.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:27:13.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-18T01:27:13.888 INFO:tasks.workunit.client.0.trial080.stdout:start osd.3 2026-02-18T01:27:13.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-18T01:27:13.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:27:13.889 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-18T01:27:13.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-18T01:27:13.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:27:13.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:27:13.889 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:27:13.904 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:13.889+0000 7f36b067ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:27:13.905 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:13.893+0000 7f36b067ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:27:13.906 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:13.893+0000 7f36b067ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:27:14.102 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-18T01:27:14.102 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:27:14.103 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T01:27:14.103 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:27:14.103 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:27:14.103 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:27:14.103 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:27:14.104 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:27:14.104 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:27:14.104 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:27:14.322 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:27:14.378 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:14.365+0000 7f36b067ca40 -1 Falling back to public interface 2026-02-18T01:27:15.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:27:15.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:27:15.324 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:27:15.325 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:27:15.325 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:27:15.325 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:27:15.538 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:27:16.136 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:27:16.121+0000 7f36b067ca40 -1 osd.3 27 log_to_monitors true 2026-02-18T01:27:16.539 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:27:16.540 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:27:16.540 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:27:16.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:27:16.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:27:16.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:27:16.752 INFO:tasks.workunit.client.0.trial080.stdout:osd.3 up in weight 1 up_from 42 up_thru 42 down_at 28 last_clean_interval [17,27) [v2:127.0.0.1:6826/3700282894,v1:127.0.0.1:6827/3700282894] [v2:127.0.0.1:6828/3700282894,v1:127.0.0.1:6829/3700282894] exists,up e11cd4c1-314c-49a7-9483-993c12116f51 2026-02-18T01:27:16.753 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:27:16.753 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:27:16.753 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:27:16.754 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-18T01:27:16.755 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: osd_pid3=105648 2026-02-18T01:27:16.755 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:152: TEST_bluestore: wait_for_clean 2026-02-18T01:27:16.755 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:27:16.755 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:27:16.755 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:27:16.756 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:27:16.756 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:27:16.756 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:27:16.756 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:27:16.757 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:27:16.757 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:27:16.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:27:16.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:27:16.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:27:16.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:27:16.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:27:16.853 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:27:17.068 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:27:17.069 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:27:17.069 INFO:tasks.workunit.client.0.trial080.stderr:2 2026-02-18T01:27:17.069 INFO:tasks.workunit.client.0.trial080.stderr:3' 2026-02-18T01:27:17.069 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:27:17.069 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:27:17.070 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:27:17.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018884 2026-02-18T01:27:17.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018884 2026-02-18T01:27:17.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-128849018884' 2026-02-18T01:27:17.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:27:17.150 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:27:17.227 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888068 2026-02-18T01:27:17.228 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888068 2026-02-18T01:27:17.228 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-128849018884 1-146028888068' 2026-02-18T01:27:17.228 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:27:17.228 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:27:17.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-18T01:27:17.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-18T01:27:17.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-128849018884 1-146028888068 2-163208757251' 2026-02-18T01:27:17.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:27:17.306 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T01:27:17.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626435 2026-02-18T01:27:17.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626435 2026-02-18T01:27:17.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-128849018884 1-146028888068 2-163208757251 3-180388626435' 2026-02-18T01:27:17.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:27:17.382 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-128849018884 2026-02-18T01:27:17.382 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:27:17.383 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:27:17.383 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-128849018884 2026-02-18T01:27:17.384 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:27:17.385 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=128849018884 2026-02-18T01:27:17.385 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 128849018884' 2026-02-18T01:27:17.385 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 128849018884 2026-02-18T01:27:17.385 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:27:17.598 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 128849018884 -lt 128849018884 2026-02-18T01:27:17.598 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:27:17.599 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-146028888068 2026-02-18T01:27:17.599 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:27:17.600 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:27:17.601 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-146028888068 2026-02-18T01:27:17.601 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:27:17.602 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888068 2026-02-18T01:27:17.603 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 146028888068 2026-02-18T01:27:17.603 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 146028888068' 2026-02-18T01:27:17.603 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:27:17.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888068 -lt 146028888068 2026-02-18T01:27:17.828 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:27:17.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757251 2026-02-18T01:27:17.829 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:27:17.830 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:27:17.831 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-163208757251 2026-02-18T01:27:17.831 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:27:17.832 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757251 2026-02-18T01:27:17.832 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 163208757251 2026-02-18T01:27:17.833 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-18T01:27:17.833 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:27:18.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 163208757251 2026-02-18T01:27:18.056 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:27:19.057 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:27:19.057 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:27:19.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 163208757251 2026-02-18T01:27:19.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:27:20.277 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T01:27:20.278 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:27:20.487 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757252 -lt 163208757251 2026-02-18T01:27:20.487 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:27:20.487 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-180388626435 2026-02-18T01:27:20.488 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:27:20.489 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T01:27:20.490 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-180388626435 2026-02-18T01:27:20.490 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:27:20.491 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=180388626435 2026-02-18T01:27:20.491 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 180388626435' 2026-02-18T01:27:20.492 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.3 seq 180388626435 2026-02-18T01:27:20.492 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T01:27:20.713 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 180388626435 -lt 180388626435 2026-02-18T01:27:20.714 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:27:20.714 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:27:20.714 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:27:20.997 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-18T01:27:20.998 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:27:20.998 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:27:20.998 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:27:20.998 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:27:20.998 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:27:20.998 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:27:20.998 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:27:21.213 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-18T01:27:21.213 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:27:21.214 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:27:21.214 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:27:21.501 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-18T01:27:21.501 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:27:21.501 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:27:21.502 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:155: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-18T01:27:21.520 INFO:tasks.workunit.client.0.trial080.stdout:hints = 1 2026-02-18T01:27:21.520 INFO:tasks.workunit.client.0.trial080.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-18T01:27:21.520 INFO:tasks.workunit.client.0.trial080.stdout:Object prefix: benchmark_data_trial080_106981 2026-02-18T01:27:21.520 INFO:tasks.workunit.client.0.trial080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T01:27:21.520 INFO:tasks.workunit.client.0.trial080.stdout: 0 0 0 0 0 0 - 0 2026-02-18T01:27:22.520 INFO:tasks.workunit.client.0.trial080.stdout: 1 15 9945 9930 38.786 38.7891 0.00154294 0.0016085 2026-02-18T01:27:23.520 INFO:tasks.workunit.client.0.trial080.stdout: 2 16 19448 19432 37.9502 37.1172 0.00147988 0.00164466 2026-02-18T01:27:24.520 INFO:tasks.workunit.client.0.trial080.stdout: 3 16 29030 29014 37.7758 37.4297 0.0016876 0.0016526 2026-02-18T01:27:25.520 INFO:tasks.workunit.client.0.trial080.stdout: 4 16 38754 38738 37.8272 37.9844 0.00151219 0.00165053 2026-02-18T01:27:26.520 INFO:tasks.workunit.client.0.trial080.stdout: 5 16 48401 48385 37.7979 37.6836 0.00154626 0.00165178 2026-02-18T01:27:27.520 INFO:tasks.workunit.client.0.trial080.stdout: 6 16 58168 58152 37.8564 38.1523 0.00159003 0.00164927 2026-02-18T01:27:28.520 INFO:tasks.workunit.client.0.trial080.stdout: 7 16 67712 67696 37.7739 37.2812 0.00237242 0.00165293 2026-02-18T01:27:29.520 INFO:tasks.workunit.client.0.trial080.stdout: 8 16 77264 77248 37.7158 37.3125 0.00155624 0.00165545 2026-02-18T01:27:30.521 INFO:tasks.workunit.client.0.trial080.stdout: 9 15 86774 86759 37.6529 37.1523 0.00110183 0.00165831 2026-02-18T01:27:31.521 INFO:tasks.workunit.client.0.trial080.stdout: 10 16 96422 96406 37.6558 37.6836 0.00182537 0.00165817 2026-02-18T01:27:32.521 INFO:tasks.workunit.client.0.trial080.stdout: 11 16 105943 105927 37.6133 37.1914 0.00189858 0.0016601 2026-02-18T01:27:33.521 INFO:tasks.workunit.client.0.trial080.stdout: 12 16 115377 115361 37.5496 36.8516 0.00181852 0.00166286 2026-02-18T01:27:34.521 INFO:tasks.workunit.client.0.trial080.stdout: 13 15 124752 124737 37.4783 36.625 0.00199078 0.00166602 2026-02-18T01:27:35.521 INFO:tasks.workunit.client.0.trial080.stdout: 14 16 134344 134328 37.4771 37.4648 0.00177328 0.00166611 2026-02-18T01:27:36.521 INFO:tasks.workunit.client.0.trial080.stdout: 15 16 144122 144106 37.5248 38.1953 0.00118499 0.00166403 2026-02-18T01:27:37.521 INFO:tasks.workunit.client.0.trial080.stdout: 16 15 153688 153673 37.515 37.3711 0.00167356 0.00166447 2026-02-18T01:27:38.521 INFO:tasks.workunit.client.0.trial080.stdout: 17 16 163194 163178 37.4922 37.1289 0.00187233 0.00166544 2026-02-18T01:27:39.521 INFO:tasks.workunit.client.0.trial080.stdout: 18 16 164517 164501 35.6964 5.16797 0.125578 0.00174709 2026-02-18T01:27:40.521 INFO:tasks.workunit.client.0.trial080.stdout: 19 16 164705 164689 33.8562 0.734375 0.0725904 0.00183685 2026-02-18T01:27:41.521 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:27:41.511433+0000 min lat: 0.000589935 max lat: 0.230231 avg lat: 0.00193694 2026-02-18T01:27:41.522 INFO:tasks.workunit.client.0.trial080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T01:27:41.522 INFO:tasks.workunit.client.0.trial080.stdout: 20 16 164907 164891 32.2029 0.789062 0.105709 0.00193694 2026-02-18T01:27:42.521 INFO:tasks.workunit.client.0.trial080.stdout: 21 16 165065 165049 30.6988 0.617188 0.127225 0.00202493 2026-02-18T01:27:43.521 INFO:tasks.workunit.client.0.trial080.stdout: 22 16 174058 174042 30.9 35.1289 0.00128671 0.00202113 2026-02-18T01:27:44.522 INFO:tasks.workunit.client.0.trial080.stdout: 23 16 183609 183593 31.1785 37.3086 0.00120672 0.00200309 2026-02-18T01:27:45.522 INFO:tasks.workunit.client.0.trial080.stdout: 24 16 192759 192743 31.3686 35.7422 0.00196053 0.00199096 2026-02-18T01:27:46.522 INFO:tasks.workunit.client.0.trial080.stdout: 25 16 202341 202325 31.6109 37.4297 0.00201632 0.00197564 2026-02-18T01:27:47.522 INFO:tasks.workunit.client.0.trial080.stdout: 26 16 211723 211707 31.8046 36.6484 0.00124147 0.0019636 2026-02-18T01:27:48.522 INFO:tasks.workunit.client.0.trial080.stdout: 27 16 212624 212608 30.757 3.51953 0.120309 0.00202717 2026-02-18T01:27:49.522 INFO:tasks.workunit.client.0.trial080.stdout: 28 16 212763 212747 29.6779 0.542969 0.097274 0.00210105 2026-02-18T01:27:50.522 INFO:tasks.workunit.client.0.trial080.stdout: 29 16 221349 221333 29.8109 33.5391 0.00145352 0.00209501 2026-02-18T01:27:51.522 INFO:tasks.workunit.client.0.trial080.stdout:Total time run: 30.0009 2026-02-18T01:27:51.522 INFO:tasks.workunit.client.0.trial080.stdout:Total writes made: 230867 2026-02-18T01:27:51.523 INFO:tasks.workunit.client.0.trial080.stdout:Write size: 4096 2026-02-18T01:27:51.523 INFO:tasks.workunit.client.0.trial080.stdout:Object size: 4096 2026-02-18T01:27:51.523 INFO:tasks.workunit.client.0.trial080.stdout:Bandwidth (MB/sec): 30.0599 2026-02-18T01:27:51.523 INFO:tasks.workunit.client.0.trial080.stdout:Stddev Bandwidth: 14.5675 2026-02-18T01:27:51.523 INFO:tasks.workunit.client.0.trial080.stdout:Max bandwidth (MB/sec): 38.7891 2026-02-18T01:27:51.523 INFO:tasks.workunit.client.0.trial080.stdout:Min bandwidth (MB/sec): 0.542969 2026-02-18T01:27:51.523 INFO:tasks.workunit.client.0.trial080.stdout:Average IOPS: 7695 2026-02-18T01:27:51.523 INFO:tasks.workunit.client.0.trial080.stdout:Stddev IOPS: 3729.27 2026-02-18T01:27:51.523 INFO:tasks.workunit.client.0.trial080.stdout:Max IOPS: 9930 2026-02-18T01:27:51.523 INFO:tasks.workunit.client.0.trial080.stdout:Min IOPS: 139 2026-02-18T01:27:51.523 INFO:tasks.workunit.client.0.trial080.stdout:Average Latency(s): 0.00207771 2026-02-18T01:27:51.523 INFO:tasks.workunit.client.0.trial080.stdout:Stddev Latency(s): 0.00632179 2026-02-18T01:27:51.524 INFO:tasks.workunit.client.0.trial080.stdout:Max latency(s): 0.230231 2026-02-18T01:27:51.524 INFO:tasks.workunit.client.0.trial080.stdout:Min latency(s): 0.000589935 2026-02-18T01:27:51.525 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 102830 2026-02-18T01:27:51.525 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: sleep 1 2026-02-18T01:27:52.526 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 102830 2026-02-18T01:27:52.527 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 158: kill: (102830) - No such process 2026-02-18T01:27:52.527 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:159: TEST_bluestore: ceph osd down 0 2026-02-18T01:27:52.738 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already down. 2026-02-18T01:27:52.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 103771 2026-02-18T01:27:52.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: sleep 1 2026-02-18T01:27:53.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 103771 2026-02-18T01:27:53.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 160: kill: (103771) - No such process 2026-02-18T01:27:53.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:161: TEST_bluestore: ceph osd down 1 2026-02-18T01:27:53.955 INFO:tasks.workunit.client.0.trial080.stderr:osd.1 is already down. 2026-02-18T01:27:53.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 104712 2026-02-18T01:27:53.964 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: sleep 1 2026-02-18T01:27:54.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 104712 2026-02-18T01:27:54.966 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 162: kill: (104712) - No such process 2026-02-18T01:27:54.966 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:163: TEST_bluestore: ceph osd down 2 2026-02-18T01:27:55.177 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already down. 2026-02-18T01:27:55.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 105648 2026-02-18T01:27:55.186 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: sleep 1 2026-02-18T01:27:56.188 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 105648 2026-02-18T01:27:56.188 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 164: kill: (105648) - No such process 2026-02-18T01:27:56.188 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:165: TEST_bluestore: ceph osd down 3 2026-02-18T01:27:56.451 INFO:tasks.workunit.client.0.trial080.stderr:osd.3 is already down. 2026-02-18T01:27:56.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:168: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-18T01:28:00.081 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:28:00.122 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:170: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal count=512 bs=1M 2026-02-18T01:28:00.441 INFO:tasks.workunit.client.0.trial080.stderr:512+0 records in 2026-02-18T01:28:00.441 INFO:tasks.workunit.client.0.trial080.stderr:512+0 records out 2026-02-18T01:28:00.441 INFO:tasks.workunit.client.0.trial080.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.318118 s, 1.7 GB/s 2026-02-18T01:28:00.442 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:171: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --dev-target td/osd-bluefs-volume-ops/0/wal --command bluefs-bdev-new-wal 2026-02-18T01:28:00.456 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:28:03.856 INFO:tasks.workunit.client.0.trial080.stdout:WAL device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal 2026-02-18T01:28:03.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:175: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-18T01:28:07.521 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:28:07.572 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:178: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-18T01:28:11.597 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:28:11.648 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:180: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db count=1024 bs=1M 2026-02-18T01:28:12.278 INFO:tasks.workunit.client.0.trial080.stderr:1024+0 records in 2026-02-18T01:28:12.279 INFO:tasks.workunit.client.0.trial080.stderr:1024+0 records out 2026-02-18T01:28:12.279 INFO:tasks.workunit.client.0.trial080.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.62878 s, 1.7 GB/s 2026-02-18T01:28:12.279 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:181: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --dev-target td/osd-bluefs-volume-ops/1/db --command bluefs-bdev-new-db 2026-02-18T01:28:12.295 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:28:17.681 INFO:tasks.workunit.client.0.trial080.stdout:DB device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db 2026-02-18T01:28:17.704 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:185: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block --dev-target td/osd-bluefs-volume-ops/1/block.db --command bluefs-bdev-migrate 2026-02-18T01:28:17.721 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:28:21.058 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:190: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-18T01:28:25.049 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:28:25.098 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:193: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-18T01:28:28.504 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:28:28.542 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:195: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-db 2026-02-18T01:28:28.560 INFO:tasks.workunit.client.0.trial080.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-18T01:28:28.560 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:28:31.197 INFO:tasks.workunit.client.0.trial080.stdout:DB device added 2026-02-18T01:28:31.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:198: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-wal 2026-02-18T01:28:31.231 INFO:tasks.workunit.client.0.trial080.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-18T01:28:31.231 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:28:34.089 INFO:tasks.workunit.client.0.trial080.stdout:WAL device added 2026-02-18T01:28:34.112 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:201: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/block.db --command bluefs-bdev-migrate 2026-02-18T01:28:34.129 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:28:37.492 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:206: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-18T01:28:40.969 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:28:41.016 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:209: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-18T01:28:44.505 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:28:44.542 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:211: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --command bluefs-bdev-new-wal 2026-02-18T01:28:44.559 INFO:tasks.workunit.client.0.trial080.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-18T01:28:44.559 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:28:47.397 INFO:tasks.workunit.client.0.trial080.stdout:WAL device added 2026-02-18T01:28:47.414 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:214: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-18T01:28:47.429 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:28:50.893 INFO:tasks.workunit.client.0.trial080.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block.db 2026-02-18T01:28:50.923 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:219: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-18T01:28:54.429 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:28:54.479 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:221: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-18T01:28:54.479 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:28:54.479 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:28:54.479 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:28:54.479 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:28:54.479 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-18T01:28:54.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:28:54.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:28:54.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:28:54.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:28:54.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-18T01:28:54.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-18T01:28:54.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:28:54.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:28:54.480 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:28:54.480 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:28:54.480 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:28:54.480 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:28:54.481 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:28:54.481 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:28:54.481 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:28:54.481 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:28:54.481 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:28:54.481 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:28:54.481 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:28:54.481 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:28:54.481 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:28:54.481 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:28:54.481 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:28:54.481 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:28:54.482 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:28:54.482 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:28:54.482 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-18T01:28:54.482 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:28:54.483 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:28:54.483 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:28:54.483 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-18T01:28:54.484 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:28:54.484 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:28:54.484 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:28:54.484 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:28:54.495 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:28:54.481+0000 7f1ec81b2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:28:54.497 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:28:54.485+0000 7f1ec81b2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:28:54.497 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:28:54.485+0000 7f1ec81b2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:28:54.700 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:28:54.700 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:28:54.701 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:28:54.701 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:28:54.701 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:28:54.701 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:28:54.701 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:28:54.702 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:28:54.702 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:28:54.702 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:28:54.911 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:28:55.046 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:28:55.033+0000 7f1ec81b2a40 -1 Falling back to public interface 2026-02-18T01:28:55.912 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:28:55.912 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:28:55.913 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:28:55.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:28:55.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:28:55.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:28:56.139 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:28:57.140 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:28:57.140 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:28:57.140 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:28:57.140 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:28:57.140 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:28:57.140 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:28:57.351 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:28:58.352 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:28:58.352 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:28:58.352 INFO:tasks.workunit.client.0.trial080.stdout:3 2026-02-18T01:28:58.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-18T01:28:58.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:28:58.353 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:28:58.568 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:28:59.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:28:59.570 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:28:59.571 INFO:tasks.workunit.client.0.trial080.stdout:4 2026-02-18T01:28:59.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-18T01:28:59.571 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:28:59.572 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:28:59.788 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:00.789 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:00.789 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:00.789 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-18T01:29:00.790 INFO:tasks.workunit.client.0.trial080.stdout:5 2026-02-18T01:29:00.790 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:00.790 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:29:01.002 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:02.003 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:02.003 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:02.004 INFO:tasks.workunit.client.0.trial080.stdout:6 2026-02-18T01:29:02.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-18T01:29:02.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:02.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:29:02.222 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:02.598 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:02.585+0000 7f1ec81b2a40 -1 osd.0 44 log_to_monitors true 2026-02-18T01:29:03.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:03.223 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:03.224 INFO:tasks.workunit.client.0.trial080.stdout:7 2026-02-18T01:29:03.224 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-18T01:29:03.224 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:03.224 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:29:03.433 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 52 up_thru 52 down_at 44 last_clean_interval [30,44) [v2:127.0.0.1:6802/3099648868,v1:127.0.0.1:6803/3099648868] [v2:127.0.0.1:6804/3099648868,v1:127.0.0.1:6805/3099648868] exists,up 781ae022-1823-4474-8be7-16f50f70fddb 2026-02-18T01:29:03.434 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:29:03.434 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:29:03.434 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:29:03.434 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-18T01:29:03.435 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: osd_pid0=113134 2026-02-18T01:29:03.435 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:223: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-18T01:29:03.435 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:29:03.435 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:29:03.435 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:29:03.436 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:29:03.437 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-18T01:29:03.438 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:29:03.438 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:29:03.438 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:29:03.439 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-18T01:29:03.440 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:29:03.440 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:29:03.440 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:29:03.440 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:29:03.456 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:03.441+0000 7f91dfdb6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:29:03.457 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:03.445+0000 7f91dfdb6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:29:03.458 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:03.445+0000 7f91dfdb6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:29:03.651 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T01:29:03.651 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:29:03.651 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:29:03.651 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:29:03.651 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:29:03.651 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:03.651 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:29:03.651 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:29:03.651 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:03.651 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:29:03.861 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:03.978 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:03.965+0000 7f91dfdb6a40 -1 Falling back to public interface 2026-02-18T01:29:04.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:04.863 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:04.863 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:29:04.863 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:29:04.864 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:04.864 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:29:05.072 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:06.073 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:06.073 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:06.073 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:29:06.073 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:29:06.073 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:06.073 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:29:06.284 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:07.286 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:07.287 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:07.287 INFO:tasks.workunit.client.0.trial080.stdout:3 2026-02-18T01:29:07.288 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-18T01:29:07.288 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:07.288 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:29:07.496 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:08.498 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:08.498 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:08.498 INFO:tasks.workunit.client.0.trial080.stdout:4 2026-02-18T01:29:08.498 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-18T01:29:08.499 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:08.499 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:29:08.709 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:09.710 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:09.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:09.711 INFO:tasks.workunit.client.0.trial080.stdout:5 2026-02-18T01:29:09.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-18T01:29:09.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:09.711 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:29:09.917 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:10.919 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:10.919 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:10.919 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-18T01:29:10.920 INFO:tasks.workunit.client.0.trial080.stdout:6 2026-02-18T01:29:10.920 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:10.920 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:29:11.137 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:12.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:12.139 INFO:tasks.workunit.client.0.trial080.stdout:7 2026-02-18T01:29:12.139 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:12.139 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-18T01:29:12.140 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:12.140 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:29:12.226 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:12.212+0000 7f91dfdb6a40 -1 osd.1 45 log_to_monitors true 2026-02-18T01:29:12.347 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:13.348 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:13.349 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:13.349 INFO:tasks.workunit.client.0.trial080.stdout:8 2026-02-18T01:29:13.350 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-18T01:29:13.350 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:13.350 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:29:13.557 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 46 last_clean_interval [34,45) [v2:127.0.0.1:6810/1770609294,v1:127.0.0.1:6811/1770609294] [v2:127.0.0.1:6812/1770609294,v1:127.0.0.1:6813/1770609294] exists,up 4e7312bd-4178-444f-9144-f60248cf99ab 2026-02-18T01:29:13.558 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:29:13.558 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:29:13.558 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:29:13.558 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-18T01:29:13.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: osd_pid1=114205 2026-02-18T01:29:13.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:225: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-18T01:29:13.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:29:13.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:29:13.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T01:29:13.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:29:13.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-18T01:29:13.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:29:13.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:29:13.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:29:13.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:29:13.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-18T01:29:13.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-18T01:29:13.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:29:13.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:29:13.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:29:13.563 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:29:13.563 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:29:13.563 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:29:13.563 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:29:13.563 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:29:13.563 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:29:13.564 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:29:13.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:29:13.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:29:13.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:29:13.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:29:13.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:29:13.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:29:13.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:29:13.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:29:13.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:29:13.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:29:13.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-18T01:29:13.565 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:29:13.566 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T01:29:13.566 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:29:13.566 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-18T01:29:13.566 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T01:29:13.566 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:29:13.566 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:29:13.566 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:29:13.576 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:13.560+0000 7f969b33fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:29:13.577 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:13.564+0000 7f969b33fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:29:13.578 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:13.564+0000 7f969b33fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:29:13.780 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T01:29:13.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:29:13.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:29:13.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:29:13.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:29:13.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:13.782 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:29:13.782 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:29:13.782 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:13.782 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:29:13.991 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:14.110 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:14.096+0000 7f969b33fa40 -1 Falling back to public interface 2026-02-18T01:29:14.993 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:14.993 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:14.994 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:29:14.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:29:14.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:14.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:29:15.211 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:16.212 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:16.212 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:16.213 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:29:16.213 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:29:16.214 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:16.214 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:29:16.425 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:17.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:17.427 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:17.427 INFO:tasks.workunit.client.0.trial080.stdout:3 2026-02-18T01:29:17.428 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-18T01:29:17.428 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:17.428 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:29:17.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:18.645 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:18.646 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:18.646 INFO:tasks.workunit.client.0.trial080.stdout:4 2026-02-18T01:29:18.647 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-18T01:29:18.647 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:18.647 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:29:18.861 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:19.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:19.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:19.862 INFO:tasks.workunit.client.0.trial080.stdout:5 2026-02-18T01:29:19.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-18T01:29:19.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:19.862 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:29:20.073 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:21.075 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:21.075 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:21.075 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-18T01:29:21.076 INFO:tasks.workunit.client.0.trial080.stdout:6 2026-02-18T01:29:21.076 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:21.076 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:29:21.296 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:21.456 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:21.440+0000 7f969b33fa40 -1 osd.2 47 log_to_monitors true 2026-02-18T01:29:22.298 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:22.298 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:22.298 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-18T01:29:22.298 INFO:tasks.workunit.client.0.trial080.stdout:7 2026-02-18T01:29:22.298 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:22.298 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:29:22.516 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 58 up_thru 58 down_at 48 last_clean_interval [38,47) [v2:127.0.0.1:6818/2454020395,v1:127.0.0.1:6819/2454020395] [v2:127.0.0.1:6820/2454020395,v1:127.0.0.1:6821/2454020395] exists,up 91c2b4fc-ad3a-4c6d-9200-c3a566760b4d 2026-02-18T01:29:22.516 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:29:22.516 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:29:22.516 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:29:22.517 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: osd_pid2=115301 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:227: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:29:22.518 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:29:22.519 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:29:22.519 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:29:22.519 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:29:22.519 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:29:22.519 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:29:22.519 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:29:22.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:29:22.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:29:22.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:29:22.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:29:22.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:29:22.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:29:22.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:29:22.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:29:22.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:29:22.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:29:22.520 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-18T01:29:22.521 INFO:tasks.workunit.client.0.trial080.stdout:start osd.3 2026-02-18T01:29:22.521 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-18T01:29:22.521 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:29:22.522 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-18T01:29:22.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-18T01:29:22.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:29:22.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:29:22.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:29:22.540 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:22.524+0000 7fc309f2fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:29:22.541 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:22.528+0000 7fc309f2fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:29:22.543 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:22.528+0000 7fc309f2fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:29:22.739 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-18T01:29:22.740 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:29:22.740 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T01:29:22.740 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:29:22.740 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:29:22.740 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:22.740 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:29:22.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:29:22.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:22.741 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:29:22.951 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:23.115 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:23.100+0000 7fc309f2fa40 -1 Falling back to public interface 2026-02-18T01:29:23.952 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:23.953 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:23.953 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:29:23.954 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:29:23.954 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:23.954 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:29:24.162 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:25.163 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:25.164 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:25.164 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:29:25.165 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:29:25.165 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:25.165 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:29:25.375 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:26.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:26.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:26.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-18T01:29:26.376 INFO:tasks.workunit.client.0.trial080.stdout:3 2026-02-18T01:29:26.376 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:26.377 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:29:26.578 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:27.579 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:27.580 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:27.580 INFO:tasks.workunit.client.0.trial080.stdout:4 2026-02-18T01:29:27.581 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-18T01:29:27.581 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:27.581 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:29:27.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:28.782 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:28.782 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:28.783 INFO:tasks.workunit.client.0.trial080.stdout:5 2026-02-18T01:29:28.783 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-18T01:29:28.783 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:28.784 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:29:28.988 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:29.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:29.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:29.990 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-18T01:29:29.990 INFO:tasks.workunit.client.0.trial080.stdout:6 2026-02-18T01:29:29.991 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:29.991 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:29:30.198 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:29:30.572 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:29:30.556+0000 7fc309f2fa40 -1 osd.3 49 log_to_monitors true 2026-02-18T01:29:31.199 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:29:31.200 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:29:31.200 INFO:tasks.workunit.client.0.trial080.stdout:7 2026-02-18T01:29:31.201 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-18T01:29:31.201 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:29:31.201 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:29:31.414 INFO:tasks.workunit.client.0.trial080.stdout:osd.3 up in weight 1 up_from 61 up_thru 61 down_at 50 last_clean_interval [42,49) [v2:127.0.0.1:6826/774069703,v1:127.0.0.1:6827/774069703] [v2:127.0.0.1:6828/774069703,v1:127.0.0.1:6829/774069703] exists,up e11cd4c1-314c-49a7-9483-993c12116f51 2026-02-18T01:29:31.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:29:31.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:29:31.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:29:31.415 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-18T01:29:31.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: osd_pid3=116372 2026-02-18T01:29:31.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:231: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-18T01:29:31.434 INFO:tasks.workunit.client.0.trial080.stdout:hints = 1 2026-02-18T01:29:31.434 INFO:tasks.workunit.client.0.trial080.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-18T01:29:31.434 INFO:tasks.workunit.client.0.trial080.stdout:Object prefix: benchmark_data_trial080_117423 2026-02-18T01:29:31.434 INFO:tasks.workunit.client.0.trial080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T01:29:31.434 INFO:tasks.workunit.client.0.trial080.stdout: 0 0 0 0 0 0 - 0 2026-02-18T01:29:32.434 INFO:tasks.workunit.client.0.trial080.stdout: 1 16 10718 10702 41.801 41.8047 0.00115627 0.00149179 2026-02-18T01:29:33.434 INFO:tasks.workunit.client.0.trial080.stdout: 2 16 21263 21247 41.4942 41.1914 0.00178388 0.00150417 2026-02-18T01:29:34.434 INFO:tasks.workunit.client.0.trial080.stdout: 3 16 28237 28221 36.7429 27.2422 0.139976 0.00164538 2026-02-18T01:29:35.434 INFO:tasks.workunit.client.0.trial080.stdout: 4 15 38218 38203 37.3045 38.9922 0.00147253 0.00167343 2026-02-18T01:29:36.435 INFO:tasks.workunit.client.0.trial080.stdout: 5 16 48706 48690 38.036 40.9648 0.00121277 0.00164133 2026-02-18T01:29:37.435 INFO:tasks.workunit.client.0.trial080.stdout: 6 16 59135 59119 38.4859 40.7383 0.00147602 0.00162224 2026-02-18T01:29:38.435 INFO:tasks.workunit.client.0.trial080.stdout: 7 16 69368 69352 38.6977 39.9727 0.0017594 0.0016134 2026-02-18T01:29:39.435 INFO:tasks.workunit.client.0.trial080.stdout: 8 16 79713 79697 38.9114 40.4102 0.00107132 0.00160453 2026-02-18T01:29:40.435 INFO:tasks.workunit.client.0.trial080.stdout: 9 16 89975 89959 39.0416 40.0859 0.00130295 0.00159924 2026-02-18T01:29:41.435 INFO:tasks.workunit.client.0.trial080.stdout: 10 16 100319 100303 39.1777 40.4062 0.00118932 0.00159368 2026-02-18T01:29:42.435 INFO:tasks.workunit.client.0.trial080.stdout: 11 16 110643 110627 39.282 40.3281 0.00128407 0.00158946 2026-02-18T01:29:43.435 INFO:tasks.workunit.client.0.trial080.stdout: 12 16 120241 120225 39.1326 37.4922 0.00140525 0.00159553 2026-02-18T01:29:44.435 INFO:tasks.workunit.client.0.trial080.stdout: 13 16 129924 129908 39.0318 37.8242 0.00152875 0.00159963 2026-02-18T01:29:45.435 INFO:tasks.workunit.client.0.trial080.stdout: 14 16 131908 131892 36.7973 7.75 0.0014431 0.00169688 2026-02-18T01:29:46.435 INFO:tasks.workunit.client.0.trial080.stdout: 15 16 141746 141730 36.906 38.4297 0.0020909 0.0016919 2026-02-18T01:29:47.435 INFO:tasks.workunit.client.0.trial080.stdout: 16 16 151295 151279 36.9305 37.3008 0.00152505 0.00169075 2026-02-18T01:29:48.435 INFO:tasks.workunit.client.0.trial080.stdout: 17 16 161091 161075 37.0088 38.2656 0.00191824 0.00168719 2026-02-18T01:29:49.436 INFO:tasks.workunit.client.0.trial080.stdout: 18 16 170801 170785 37.0598 37.9297 0.00196742 0.00168487 2026-02-18T01:29:50.436 INFO:tasks.workunit.client.0.trial080.stdout: 19 16 180667 180651 37.1375 38.5391 0.00151326 0.00168136 2026-02-18T01:29:51.436 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:29:51.425052+0000 min lat: 0.000520561 max lat: 0.150319 avg lat: 0.00167893 2026-02-18T01:29:51.436 INFO:tasks.workunit.client.0.trial080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T01:29:51.436 INFO:tasks.workunit.client.0.trial080.stdout: 20 15 190450 190435 37.1914 38.2188 0.00159796 0.00167893 2026-02-18T01:29:52.436 INFO:tasks.workunit.client.0.trial080.stdout: 21 16 200415 200399 37.2737 38.9219 0.00170999 0.00167524 2026-02-18T01:29:53.436 INFO:tasks.workunit.client.0.trial080.stdout: 22 15 210027 210012 37.2862 37.5508 0.00152215 0.00167466 2026-02-18T01:29:54.436 INFO:tasks.workunit.client.0.trial080.stdout: 23 16 219641 219625 37.2975 37.5508 0.00256627 0.00167416 2026-02-18T01:29:55.436 INFO:tasks.workunit.client.0.trial080.stdout: 24 16 229478 229462 37.3444 38.4258 0.00142812 0.00167203 2026-02-18T01:29:56.436 INFO:tasks.workunit.client.0.trial080.stdout: 25 16 231168 231152 36.1147 6.60156 0.131438 0.00172476 2026-02-18T01:29:57.436 INFO:tasks.workunit.client.0.trial080.stdout: 26 16 231272 231256 34.7413 0.40625 0.125646 0.00179268 2026-02-18T01:29:58.436 INFO:tasks.workunit.client.0.trial080.stdout: 27 16 237662 237646 34.379 24.9609 0.001626 0.00181641 2026-02-18T01:29:59.436 INFO:tasks.workunit.client.0.trial080.stdout: 28 16 247393 247377 34.5086 38.0117 0.00199443 0.00180961 2026-02-18T01:30:00.437 INFO:tasks.workunit.client.0.trial080.stdout: 29 16 256760 256744 34.5803 36.5898 0.00169305 0.00180585 2026-02-18T01:30:01.437 INFO:tasks.workunit.client.0.trial080.stdout:Total time run: 30.0011 2026-02-18T01:30:01.437 INFO:tasks.workunit.client.0.trial080.stdout:Total writes made: 266112 2026-02-18T01:30:01.437 INFO:tasks.workunit.client.0.trial080.stdout:Write size: 4096 2026-02-18T01:30:01.437 INFO:tasks.workunit.client.0.trial080.stdout:Object size: 4096 2026-02-18T01:30:01.437 INFO:tasks.workunit.client.0.trial080.stdout:Bandwidth (MB/sec): 34.6488 2026-02-18T01:30:01.437 INFO:tasks.workunit.client.0.trial080.stdout:Stddev Bandwidth: 10.9109 2026-02-18T01:30:01.437 INFO:tasks.workunit.client.0.trial080.stdout:Max bandwidth (MB/sec): 41.8047 2026-02-18T01:30:01.437 INFO:tasks.workunit.client.0.trial080.stdout:Min bandwidth (MB/sec): 0.40625 2026-02-18T01:30:01.438 INFO:tasks.workunit.client.0.trial080.stdout:Average IOPS: 8870 2026-02-18T01:30:01.438 INFO:tasks.workunit.client.0.trial080.stdout:Stddev IOPS: 2793.2 2026-02-18T01:30:01.438 INFO:tasks.workunit.client.0.trial080.stdout:Max IOPS: 10702 2026-02-18T01:30:01.438 INFO:tasks.workunit.client.0.trial080.stdout:Min IOPS: 104 2026-02-18T01:30:01.438 INFO:tasks.workunit.client.0.trial080.stdout:Average Latency(s): 0.00180229 2026-02-18T01:30:01.438 INFO:tasks.workunit.client.0.trial080.stdout:Stddev Latency(s): 0.00487666 2026-02-18T01:30:01.438 INFO:tasks.workunit.client.0.trial080.stdout:Max latency(s): 0.211537 2026-02-18T01:30:01.438 INFO:tasks.workunit.client.0.trial080.stdout:Min latency(s): 0.000520561 2026-02-18T01:30:01.440 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 113134 2026-02-18T01:30:01.440 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: sleep 1 2026-02-18T01:30:02.442 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 113134 2026-02-18T01:30:02.442 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 234: kill: (113134) - No such process 2026-02-18T01:30:02.442 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:235: TEST_bluestore: ceph osd down 0 2026-02-18T01:30:02.646 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already down. 2026-02-18T01:30:02.656 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 114205 2026-02-18T01:30:02.656 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: sleep 1 2026-02-18T01:30:03.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 114205 2026-02-18T01:30:03.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 236: kill: (114205) - No such process 2026-02-18T01:30:03.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:237: TEST_bluestore: ceph osd down 1 2026-02-18T01:30:04.164 INFO:tasks.workunit.client.0.trial080.stderr:osd.1 is already down. 2026-02-18T01:30:04.175 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 115301 2026-02-18T01:30:04.175 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: sleep 1 2026-02-18T01:30:05.177 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 115301 2026-02-18T01:30:05.177 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 238: kill: (115301) - No such process 2026-02-18T01:30:05.177 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:239: TEST_bluestore: ceph osd down 2 2026-02-18T01:30:05.387 INFO:tasks.workunit.client.0.trial080.stderr:osd.2 is already down. 2026-02-18T01:30:05.396 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 116372 2026-02-18T01:30:05.396 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: sleep 1 2026-02-18T01:30:06.398 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 116372 2026-02-18T01:30:06.398 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 240: kill: (116372) - No such process 2026-02-18T01:30:06.399 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:241: TEST_bluestore: ceph osd down 3 2026-02-18T01:30:06.655 INFO:tasks.workunit.client.0.trial080.stderr:osd.3 is already down. 2026-02-18T01:30:06.664 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:244: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-18T01:30:11.641 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:30:11.705 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:246: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/db2 count=1024 bs=1M 2026-02-18T01:30:12.310 INFO:tasks.workunit.client.0.trial080.stderr:1024+0 records in 2026-02-18T01:30:12.310 INFO:tasks.workunit.client.0.trial080.stderr:1024+0 records out 2026-02-18T01:30:12.310 INFO:tasks.workunit.client.0.trial080.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.602891 s, 1.8 GB/s 2026-02-18T01:30:12.311 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:247: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/db2 --command bluefs-bdev-migrate 2026-02-18T01:30:12.327 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:30:17.190 INFO:tasks.workunit.client.0.trial080.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-18T01:30:17.190 INFO:tasks.workunit.client.0.trial080.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/db2 2026-02-18T01:30:17.218 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:252: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-18T01:30:22.253 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:30:22.312 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:256: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal2 count=512 bs=1M 2026-02-18T01:30:22.617 INFO:tasks.workunit.client.0.trial080.stderr:512+0 records in 2026-02-18T01:30:22.617 INFO:tasks.workunit.client.0.trial080.stderr:512+0 records out 2026-02-18T01:30:22.618 INFO:tasks.workunit.client.0.trial080.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.303852 s, 1.8 GB/s 2026-02-18T01:30:22.618 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:257: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/wal2 --command bluefs-bdev-migrate 2026-02-18T01:30:22.635 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:30:27.382 INFO:tasks.workunit.client.0.trial080.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-18T01:30:27.382 INFO:tasks.workunit.client.0.trial080.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal2 2026-02-18T01:30:27.414 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:261: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/0/wal 2026-02-18T01:30:27.481 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:263: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-18T01:30:32.386 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:30:32.450 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:266: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-18T01:30:37.418 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:30:37.471 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:268: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db2 count=1024 bs=1M 2026-02-18T01:30:38.082 INFO:tasks.workunit.client.0.trial080.stderr:1024+0 records in 2026-02-18T01:30:38.083 INFO:tasks.workunit.client.0.trial080.stderr:1024+0 records out 2026-02-18T01:30:38.083 INFO:tasks.workunit.client.0.trial080.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.609819 s, 1.8 GB/s 2026-02-18T01:30:38.083 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:269: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --devs-source td/osd-bluefs-volume-ops/1/block.wal --dev-target td/osd-bluefs-volume-ops/1/db2 --command bluefs-bdev-migrate 2026-02-18T01:30:38.094 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:30:43.518 INFO:tasks.workunit.client.0.trial080.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-18T01:30:43.518 INFO:tasks.workunit.client.0.trial080.stdout: device removed:0 td/osd-bluefs-volume-ops/1/block.wal 2026-02-18T01:30:43.518 INFO:tasks.workunit.client.0.trial080.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db2 2026-02-18T01:30:43.542 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:275: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db 2026-02-18T01:30:43.661 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:277: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-18T01:30:48.634 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:30:48.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:279: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-18T01:30:48.708 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:30:53.190 INFO:tasks.workunit.client.0.trial080.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-18T01:30:53.227 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:284: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db2 2026-02-18T01:30:53.354 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:286: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-18T01:30:58.218 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:30:58.274 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:289: TEST_bluestore: ceph-objectstore-tool --type bluestore --data-path td/osd-bluefs-volume-ops/2 --op fsck --no-mon-config 2026-02-18T01:31:03.022 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:31:03.085 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:292: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-18T01:31:03.722 INFO:tasks.workunit.client.0.trial080.stderr:1024+0 records in 2026-02-18T01:31:03.722 INFO:tasks.workunit.client.0.trial080.stderr:1024+0 records out 2026-02-18T01:31:03.722 INFO:tasks.workunit.client.0.trial080.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.63505 s, 1.7 GB/s 2026-02-18T01:31:03.722 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:293: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-18T01:31:03.740 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:31:03.862 INFO:tasks.workunit.client.0.trial080.stderr:Unable to migrate Slow volume to new location, please allocate new DB or WAL with --bluefs-bdev-new-db(wal) command 2026-02-18T01:31:03.864 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:299: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-18T01:31:03.864 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:302: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-18T01:31:08.358 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:31:08.415 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:305: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-18T01:31:09.816 INFO:tasks.workunit.client.0.trial080.stderr:1024+0 records in 2026-02-18T01:31:09.816 INFO:tasks.workunit.client.0.trial080.stderr:1024+0 records out 2026-02-18T01:31:09.816 INFO:tasks.workunit.client.0.trial080.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 1.25856 s, 853 MB/s 2026-02-18T01:31:09.816 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:307: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --devs-source td/osd-bluefs-volume-ops/2/block.db --devs-source td/osd-bluefs-volume-ops/2/block.wal --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-18T01:31:09.830 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:31:13.994 INFO:tasks.workunit.client.0.trial080.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-18T01:31:13.995 INFO:tasks.workunit.client.0.trial080.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-18T01:31:13.995 INFO:tasks.workunit.client.0.trial080.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/2/db2 2026-02-18T01:31:14.030 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:314: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-18T01:31:18.382 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:31:18.433 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:317: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/3/wal2 count=1024 bs=1M 2026-02-18T01:31:19.053 INFO:tasks.workunit.client.0.trial080.stderr:1024+0 records in 2026-02-18T01:31:19.053 INFO:tasks.workunit.client.0.trial080.stderr:1024+0 records out 2026-02-18T01:31:19.053 INFO:tasks.workunit.client.0.trial080.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.618993 s, 1.7 GB/s 2026-02-18T01:31:19.054 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:319: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/wal2 --command bluefs-bdev-migrate 2026-02-18T01:31:19.071 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:31:23.898 INFO:tasks.workunit.client.0.trial080.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block 2026-02-18T01:31:23.899 INFO:tasks.workunit.client.0.trial080.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-18T01:31:23.899 INFO:tasks.workunit.client.0.trial080.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/3/wal2 2026-02-18T01:31:23.933 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:325: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-18T01:31:28.330 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:31:28.380 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:327: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:31:28.381 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:31:28.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:31:28.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:31:28.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:31:28.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:31:28.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:31:28.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:31:28.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:31:28.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:31:28.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:31:28.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:31:28.382 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-18T01:31:28.383 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:31:28.383 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:31:28.384 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:31:28.384 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-18T01:31:28.385 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:31:28.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:31:28.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:31:28.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:31:28.407 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:28.391+0000 7f64b35f7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:31:28.409 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:28.391+0000 7f64b35f7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:31:28.410 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:28.391+0000 7f64b35f7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:31:28.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:31:28.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:31:28.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:31:28.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:31:28.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:31:28.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:28.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:31:28.607 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:31:28.608 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:28.608 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:31:28.819 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:28.928 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:28.911+0000 7f64b35f7a40 -1 Falling back to public interface 2026-02-18T01:31:29.820 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:29.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:29.821 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:31:29.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:31:29.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:29.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:31:30.038 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:31.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:31.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:31.039 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:31:31.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:31:31.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:31.039 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:31:31.256 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:32.257 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:32.258 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:32.258 INFO:tasks.workunit.client.0.trial080.stdout:3 2026-02-18T01:31:32.258 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-18T01:31:32.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:32.259 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:31:32.472 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:33.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:33.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:33.474 INFO:tasks.workunit.client.0.trial080.stdout:4 2026-02-18T01:31:33.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-18T01:31:33.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:33.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:31:33.689 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:34.690 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:34.691 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:34.691 INFO:tasks.workunit.client.0.trial080.stdout:5 2026-02-18T01:31:34.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-18T01:31:34.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:34.692 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:31:34.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:35.906 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:35.906 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:35.906 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-18T01:31:35.907 INFO:tasks.workunit.client.0.trial080.stdout:6 2026-02-18T01:31:35.907 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:35.907 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:31:36.120 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:37.122 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:37.122 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:37.123 INFO:tasks.workunit.client.0.trial080.stdout:7 2026-02-18T01:31:37.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-18T01:31:37.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:37.124 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:31:37.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:38.339 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:38.339 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:38.339 INFO:tasks.workunit.client.0.trial080.stdout:8 2026-02-18T01:31:38.340 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-18T01:31:38.340 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:38.340 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:31:38.412 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:38.395+0000 7f64b35f7a40 -1 osd.0 63 log_to_monitors true 2026-02-18T01:31:38.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:39.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:39.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:39.564 INFO:tasks.workunit.client.0.trial080.stdout:9 2026-02-18T01:31:39.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2026-02-18T01:31:39.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:39.565 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:31:39.774 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 71 up_thru 71 down_at 63 last_clean_interval [52,63) [v2:127.0.0.1:6802/4086272460,v1:127.0.0.1:6803/4086272460] [v2:127.0.0.1:6804/4086272460,v1:127.0.0.1:6805/4086272460] exists,up 781ae022-1823-4474-8be7-16f50f70fddb 2026-02-18T01:31:39.774 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:31:39.774 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:31:39.774 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:31:39.775 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-18T01:31:39.778 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: osd_pid0=123598 2026-02-18T01:31:39.778 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:329: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-18T01:31:39.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:31:39.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:31:39.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:31:39.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:31:39.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-18T01:31:39.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:31:39.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:31:39.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:31:39.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:31:39.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-18T01:31:39.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-18T01:31:39.780 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:31:39.780 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:31:39.780 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:31:39.780 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:31:39.780 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:31:39.780 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:31:39.780 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:31:39.780 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:31:39.780 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:31:39.780 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:31:39.780 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:31:39.780 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:31:39.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:31:39.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:31:39.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:31:39.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:31:39.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:31:39.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:31:39.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:31:39.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:31:39.781 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-18T01:31:39.782 INFO:tasks.workunit.client.0.trial080.stdout:start osd.1 2026-02-18T01:31:39.783 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:31:39.783 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:31:39.783 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-18T01:31:39.783 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:31:39.783 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:31:39.783 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:31:39.783 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:31:39.802 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:39.787+0000 7f4af4207a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:31:39.804 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:39.787+0000 7f4af4207a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:31:39.805 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:39.787+0000 7f4af4207a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:31:39.993 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T01:31:39.993 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:31:39.993 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:31:39.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:31:39.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:31:39.994 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:39.994 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:31:39.995 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:31:39.995 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:39.995 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:31:40.184 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:40.167+0000 7f4af4207a40 -1 Falling back to public interface 2026-02-18T01:31:40.207 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:41.209 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:41.209 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:41.209 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:31:41.210 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:31:41.210 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:41.210 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:31:41.417 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:42.419 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:42.419 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:42.419 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:31:42.420 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:31:42.420 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:42.420 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:31:42.630 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:43.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:43.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:43.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-18T01:31:43.632 INFO:tasks.workunit.client.0.trial080.stdout:3 2026-02-18T01:31:43.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:43.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:31:43.841 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:44.843 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:44.843 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:44.844 INFO:tasks.workunit.client.0.trial080.stdout:4 2026-02-18T01:31:44.844 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-18T01:31:44.844 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:44.844 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:31:45.053 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:46.054 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:46.055 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:46.055 INFO:tasks.workunit.client.0.trial080.stdout:5 2026-02-18T01:31:46.056 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-18T01:31:46.056 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:46.056 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:31:46.262 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:47.263 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:47.264 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:47.264 INFO:tasks.workunit.client.0.trial080.stdout:6 2026-02-18T01:31:47.265 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-18T01:31:47.265 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:47.265 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:31:47.470 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:48.472 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:48.472 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:48.472 INFO:tasks.workunit.client.0.trial080.stdout:7 2026-02-18T01:31:48.473 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-18T01:31:48.473 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:48.473 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:31:48.682 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:49.683 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:49.683 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:49.684 INFO:tasks.workunit.client.0.trial080.stdout:8 2026-02-18T01:31:49.684 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-18T01:31:49.684 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:49.684 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:31:49.876 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:49.858+0000 7f4af4207a40 -1 osd.1 64 log_to_monitors true 2026-02-18T01:31:49.902 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:50.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:50.904 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:50.905 INFO:tasks.workunit.client.0.trial080.stdout:9 2026-02-18T01:31:50.905 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2026-02-18T01:31:50.905 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:50.906 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:31:51.117 INFO:tasks.workunit.client.0.trial080.stdout:osd.1 up in weight 1 up_from 74 up_thru 74 down_at 65 last_clean_interval [55,64) [v2:127.0.0.1:6810/3106170633,v1:127.0.0.1:6811/3106170633] [v2:127.0.0.1:6812/3106170633,v1:127.0.0.1:6813/3106170633] exists,up 4e7312bd-4178-444f-9144-f60248cf99ab 2026-02-18T01:31:51.118 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:31:51.118 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:31:51.118 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:31:51.119 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-18T01:31:51.122 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: osd_pid1=124720 2026-02-18T01:31:51.122 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:331: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-18T01:31:51.122 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:31:51.122 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:31:51.122 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T01:31:51.122 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:31:51.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-18T01:31:51.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:31:51.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:31:51.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:31:51.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:31:51.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-18T01:31:51.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-18T01:31:51.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:31:51.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:31:51.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:31:51.123 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:31:51.124 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:31:51.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:31:51.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:31:51.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:31:51.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-18T01:31:51.125 INFO:tasks.workunit.client.0.trial080.stdout:start osd.2 2026-02-18T01:31:51.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T01:31:51.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:31:51.126 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-18T01:31:51.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T01:31:51.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:31:51.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:31:51.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:31:51.142 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:51.122+0000 7f9a8effca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:31:51.143 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:51.126+0000 7f9a8effca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:31:51.144 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:51.126+0000 7f9a8effca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:31:51.339 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T01:31:51.340 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:31:51.340 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:31:51.340 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:31:51.340 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:31:51.340 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:51.340 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:31:51.341 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:31:51.341 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:51.341 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:31:51.536 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:31:51.518+0000 7f9a8effca40 -1 Falling back to public interface 2026-02-18T01:31:51.560 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:52.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:52.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:52.563 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:31:52.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:31:52.563 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:52.564 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:31:52.777 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:53.778 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:53.778 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:53.779 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:31:53.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:31:53.780 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:53.780 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:31:53.998 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:54.999 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:54.999 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:55.000 INFO:tasks.workunit.client.0.trial080.stdout:3 2026-02-18T01:31:55.001 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-18T01:31:55.001 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:55.001 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:31:55.214 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:56.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:56.215 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:56.216 INFO:tasks.workunit.client.0.trial080.stdout:4 2026-02-18T01:31:56.216 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-18T01:31:56.217 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:56.217 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:31:56.428 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:57.430 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:57.430 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:57.430 INFO:tasks.workunit.client.0.trial080.stdout:5 2026-02-18T01:31:57.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-18T01:31:57.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:57.431 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:31:57.644 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:58.646 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:58.646 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:58.646 INFO:tasks.workunit.client.0.trial080.stdout:6 2026-02-18T01:31:58.647 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-18T01:31:58.647 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:58.647 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:31:58.865 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:31:59.866 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:31:59.867 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:31:59.867 INFO:tasks.workunit.client.0.trial080.stdout:7 2026-02-18T01:31:59.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-18T01:31:59.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:31:59.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:32:00.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:32:00.486 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:00.466+0000 7f9a8effca40 -1 osd.2 66 log_to_monitors true 2026-02-18T01:32:01.089 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:32:01.089 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:01.090 INFO:tasks.workunit.client.0.trial080.stdout:8 2026-02-18T01:32:01.090 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-18T01:32:01.090 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:01.091 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:32:01.301 INFO:tasks.workunit.client.0.trial080.stdout:osd.2 up in weight 1 up_from 78 up_thru 78 down_at 67 last_clean_interval [58,66) [v2:127.0.0.1:6818/1761509337,v1:127.0.0.1:6819/1761509337] [v2:127.0.0.1:6820/1761509337,v1:127.0.0.1:6821/1761509337] exists,up 91c2b4fc-ad3a-4c6d-9200-c3a566760b4d 2026-02-18T01:32:01.301 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:32:01.301 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:32:01.302 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:32:01.302 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-18T01:32:01.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: osd_pid2=125831 2026-02-18T01:32:01.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:333: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-18T01:32:01.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:32:01.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:32:01.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-18T01:32:01.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:32:01.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-18T01:32:01.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-18T01:32:01.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:32:01.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:32:01.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:32:01.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-18T01:32:01.307 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-18T01:32:01.307 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:32:01.307 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:32:01.307 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:32:01.307 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:32:01.307 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:32:01.307 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:32:01.307 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:32:01.307 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:32:01.307 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:32:01.307 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:32:01.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:32:01.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:32:01.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:32:01.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:32:01.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:32:01.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:32:01.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:32:01.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:32:01.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:32:01.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:32:01.308 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-18T01:32:01.309 INFO:tasks.workunit.client.0.trial080.stdout:start osd.3 2026-02-18T01:32:01.310 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-18T01:32:01.310 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:32:01.310 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-18T01:32:01.310 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-18T01:32:01.310 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:32:01.310 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:32:01.310 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:32:01.324 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:01.306+0000 7fd474d2aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:32:01.325 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:01.306+0000 7fd474d2aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:32:01.326 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:01.306+0000 7fd474d2aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:32:01.515 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-18T01:32:01.515 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:32:01.515 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T01:32:01.515 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:32:01.515 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:32:01.515 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:01.516 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:32:01.516 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:32:01.516 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:01.517 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:32:01.729 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:32:01.808 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:01.794+0000 7fd474d2aa40 -1 Falling back to public interface 2026-02-18T01:32:02.731 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:32:02.731 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:02.731 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:32:02.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:32:02.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:02.732 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:32:02.935 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:32:03.937 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:32:03.937 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:03.937 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:32:03.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:32:03.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:03.938 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:32:04.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:32:05.148 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:32:05.148 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:05.149 INFO:tasks.workunit.client.0.trial080.stdout:3 2026-02-18T01:32:05.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-18T01:32:05.149 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:05.150 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:32:05.361 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:32:06.362 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:32:06.362 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:06.363 INFO:tasks.workunit.client.0.trial080.stdout:4 2026-02-18T01:32:06.363 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-18T01:32:06.363 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:06.363 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:32:06.578 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:32:07.579 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:32:07.579 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:07.580 INFO:tasks.workunit.client.0.trial080.stdout:5 2026-02-18T01:32:07.580 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-18T01:32:07.580 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:07.581 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:32:07.791 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:32:08.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:32:08.793 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:08.793 INFO:tasks.workunit.client.0.trial080.stdout:6 2026-02-18T01:32:08.794 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-18T01:32:08.794 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:08.794 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:32:09.009 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:32:10.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:32:10.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:10.011 INFO:tasks.workunit.client.0.trial080.stdout:7 2026-02-18T01:32:10.012 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-18T01:32:10.012 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:10.012 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:32:10.217 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:32:10.995 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:10.982+0000 7fd474d2aa40 -1 osd.3 68 log_to_monitors true 2026-02-18T01:32:11.218 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:32:11.219 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:11.219 INFO:tasks.workunit.client.0.trial080.stdout:8 2026-02-18T01:32:11.220 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-18T01:32:11.220 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:11.220 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T01:32:11.434 INFO:tasks.workunit.client.0.trial080.stdout:osd.3 up in weight 1 up_from 81 up_thru 81 down_at 69 last_clean_interval [61,68) [v2:127.0.0.1:6826/3097644357,v1:127.0.0.1:6827/3097644357] [v2:127.0.0.1:6828/3097644357,v1:127.0.0.1:6829/3097644357] exists,up e11cd4c1-314c-49a7-9483-993c12116f51 2026-02-18T01:32:11.435 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:32:11.435 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:32:11.435 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:32:11.436 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-18T01:32:11.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: osd_pid3=126922 2026-02-18T01:32:11.436 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:337: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-18T01:32:11.456 INFO:tasks.workunit.client.0.trial080.stdout:hints = 1 2026-02-18T01:32:11.456 INFO:tasks.workunit.client.0.trial080.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-18T01:32:11.456 INFO:tasks.workunit.client.0.trial080.stdout:Object prefix: benchmark_data_trial080_127998 2026-02-18T01:32:11.456 INFO:tasks.workunit.client.0.trial080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T01:32:11.456 INFO:tasks.workunit.client.0.trial080.stdout: 0 0 0 0 0 0 - 0 2026-02-18T01:32:12.456 INFO:tasks.workunit.client.0.trial080.stdout: 1 16 10869 10853 42.3905 42.3945 0.000861382 0.00147093 2026-02-18T01:32:13.456 INFO:tasks.workunit.client.0.trial080.stdout: 2 16 21625 21609 42.2014 42.0156 0.00118885 0.00147904 2026-02-18T01:32:14.456 INFO:tasks.workunit.client.0.trial080.stdout: 3 16 31173 31157 40.5656 37.2969 0.0567235 0.00152237 2026-02-18T01:32:15.456 INFO:tasks.workunit.client.0.trial080.stdout: 4 16 38448 38432 37.5282 28.418 0.00145729 0.0016636 2026-02-18T01:32:16.456 INFO:tasks.workunit.client.0.trial080.stdout: 5 16 49124 49108 38.3625 41.7031 0.00124606 0.00162737 2026-02-18T01:32:17.456 INFO:tasks.workunit.client.0.trial080.stdout: 6 16 59692 59676 38.8484 41.2812 0.00116051 0.00160704 2026-02-18T01:32:18.456 INFO:tasks.workunit.client.0.trial080.stdout: 7 16 70273 70257 39.2027 41.332 0.00113423 0.00159257 2026-02-18T01:32:19.456 INFO:tasks.workunit.client.0.trial080.stdout: 8 16 80916 80900 39.4989 41.5742 0.00146255 0.00158065 2026-02-18T01:32:20.457 INFO:tasks.workunit.client.0.trial080.stdout: 9 16 91472 91456 39.6913 41.2344 0.00166328 0.00157303 2026-02-18T01:32:21.457 INFO:tasks.workunit.client.0.trial080.stdout: 10 16 102126 102110 39.8836 41.6172 0.00148094 0.00156538 2026-02-18T01:32:22.457 INFO:tasks.workunit.client.0.trial080.stdout: 11 16 112490 112474 39.9379 40.4844 0.00136092 0.00156331 2026-02-18T01:32:23.457 INFO:tasks.workunit.client.0.trial080.stdout: 12 16 122992 122976 40.0281 41.0234 0.0016425 0.00155978 2026-02-18T01:32:24.457 INFO:tasks.workunit.client.0.trial080.stdout: 13 16 133710 133694 40.1693 41.8672 0.001393 0.00155433 2026-02-18T01:32:25.457 INFO:tasks.workunit.client.0.trial080.stdout: 14 16 140689 140673 39.2472 27.2617 0.0347323 0.00158945 2026-02-18T01:32:26.457 INFO:tasks.workunit.client.0.trial080.stdout: 15 16 145882 145866 37.983 20.2852 0.000712835 0.00164372 2026-02-18T01:32:27.457 INFO:tasks.workunit.client.0.trial080.stdout: 16 16 156245 156229 38.1389 40.4805 0.00109438 0.00163717 2026-02-18T01:32:28.457 INFO:tasks.workunit.client.0.trial080.stdout: 17 16 166694 166678 38.2962 40.8164 0.00116523 0.00163043 2026-02-18T01:32:29.458 INFO:tasks.workunit.client.0.trial080.stdout: 18 16 176922 176906 38.388 39.9531 0.00173927 0.00162654 2026-02-18T01:32:30.457 INFO:tasks.workunit.client.0.trial080.stdout: 19 16 187023 187007 38.444 39.457 0.00239876 0.00162416 2026-02-18T01:32:31.458 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:32:31.445046+0000 min lat: 0.0005481 max lat: 0.126344 avg lat: 0.00165962 2026-02-18T01:32:31.458 INFO:tasks.workunit.client.0.trial080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T01:32:31.458 INFO:tasks.workunit.client.0.trial080.stdout: 20 16 192467 192451 37.585 21.2656 0.0363752 0.00165962 2026-02-18T01:32:32.458 INFO:tasks.workunit.client.0.trial080.stdout: 21 16 192699 192683 35.8384 0.90625 0.038483 0.00173488 2026-02-18T01:32:33.458 INFO:tasks.workunit.client.0.trial080.stdout: 22 16 192868 192852 34.2394 0.660156 0.0628423 0.00182031 2026-02-18T01:32:34.458 INFO:tasks.workunit.client.0.trial080.stdout: 23 16 200126 200110 33.9833 28.3516 0.00121809 0.00183756 2026-02-18T01:32:35.458 INFO:tasks.workunit.client.0.trial080.stdout: 24 16 210232 210216 34.2121 39.4766 0.00167061 0.00182528 2026-02-18T01:32:36.458 INFO:tasks.workunit.client.0.trial080.stdout: 25 16 220315 220299 34.4189 39.3867 0.00125963 0.00181427 2026-02-18T01:32:37.458 INFO:tasks.workunit.client.0.trial080.stdout: 26 16 230182 230166 34.5775 38.543 0.00159772 0.00180597 2026-02-18T01:32:38.458 INFO:tasks.workunit.client.0.trial080.stdout: 27 16 240094 240078 34.7307 38.7188 0.00173721 0.00179799 2026-02-18T01:32:39.458 INFO:tasks.workunit.client.0.trial080.stdout: 28 16 250130 250114 34.8903 39.2031 0.0017403 0.00178978 2026-02-18T01:32:40.458 INFO:tasks.workunit.client.0.trial080.stdout: 29 16 260126 260110 35.0336 39.0469 0.00263444 0.00178245 2026-02-18T01:32:41.459 INFO:tasks.workunit.client.0.trial080.stdout: 30 4 269874 269870 35.1365 38.125 0.000993929 0.00177714 2026-02-18T01:32:42.459 INFO:tasks.workunit.client.0.trial080.stdout:Total time run: 30.0037 2026-02-18T01:32:42.459 INFO:tasks.workunit.client.0.trial080.stdout:Total writes made: 269874 2026-02-18T01:32:42.459 INFO:tasks.workunit.client.0.trial080.stdout:Write size: 4096 2026-02-18T01:32:42.459 INFO:tasks.workunit.client.0.trial080.stdout:Object size: 4096 2026-02-18T01:32:42.460 INFO:tasks.workunit.client.0.trial080.stdout:Bandwidth (MB/sec): 35.1355 2026-02-18T01:32:42.460 INFO:tasks.workunit.client.0.trial080.stdout:Stddev Bandwidth: 11.1175 2026-02-18T01:32:42.460 INFO:tasks.workunit.client.0.trial080.stdout:Max bandwidth (MB/sec): 42.3945 2026-02-18T01:32:42.460 INFO:tasks.workunit.client.0.trial080.stdout:Min bandwidth (MB/sec): 0.660156 2026-02-18T01:32:42.460 INFO:tasks.workunit.client.0.trial080.stdout:Average IOPS: 8994 2026-02-18T01:32:42.460 INFO:tasks.workunit.client.0.trial080.stdout:Stddev IOPS: 2846.09 2026-02-18T01:32:42.460 INFO:tasks.workunit.client.0.trial080.stdout:Max IOPS: 10853 2026-02-18T01:32:42.460 INFO:tasks.workunit.client.0.trial080.stdout:Min IOPS: 169 2026-02-18T01:32:42.460 INFO:tasks.workunit.client.0.trial080.stdout:Average Latency(s): 0.00177717 2026-02-18T01:32:42.460 INFO:tasks.workunit.client.0.trial080.stdout:Stddev Latency(s): 0.00418946 2026-02-18T01:32:42.460 INFO:tasks.workunit.client.0.trial080.stdout:Max latency(s): 0.162241 2026-02-18T01:32:42.460 INFO:tasks.workunit.client.0.trial080.stdout:Min latency(s): 0.0005481 2026-02-18T01:32:42.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:339: TEST_bluestore: wait_for_clean 2026-02-18T01:32:42.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:32:42.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:32:42.466 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:32:42.467 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:32:42.467 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:32:42.467 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:32:42.467 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:32:42.468 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:32:42.468 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:32:42.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:32:42.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:32:42.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:32:42.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:32:42.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:32:42.556 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:32:42.774 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:32:42.775 INFO:tasks.workunit.client.0.trial080.stderr:1 2026-02-18T01:32:42.775 INFO:tasks.workunit.client.0.trial080.stderr:2 2026-02-18T01:32:42.775 INFO:tasks.workunit.client.0.trial080.stderr:3' 2026-02-18T01:32:42.775 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:32:42.775 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:32:42.775 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:32:42.852 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=304942678031 2026-02-18T01:32:42.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 304942678031 2026-02-18T01:32:42.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-304942678031' 2026-02-18T01:32:42.853 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:32:42.853 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:32:42.931 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=317827579917 2026-02-18T01:32:42.932 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 317827579917 2026-02-18T01:32:42.932 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-304942678031 1-317827579917' 2026-02-18T01:32:42.932 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:32:42.932 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:32:43.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449099 2026-02-18T01:32:43.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449099 2026-02-18T01:32:43.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-304942678031 1-317827579917 2-335007449099' 2026-02-18T01:32:43.011 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:32:43.011 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T01:32:43.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=347892350985 2026-02-18T01:32:43.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 347892350985 2026-02-18T01:32:43.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-304942678031 1-317827579917 2-335007449099 3-347892350985' 2026-02-18T01:32:43.088 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:32:43.089 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-304942678031 2026-02-18T01:32:43.089 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:32:43.090 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:32:43.091 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-304942678031 2026-02-18T01:32:43.091 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:32:43.092 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=304942678031 2026-02-18T01:32:43.092 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 304942678031' 2026-02-18T01:32:43.092 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 304942678031 2026-02-18T01:32:43.093 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:32:43.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 304942678029 -lt 304942678031 2026-02-18T01:32:43.305 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:32:44.306 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:32:44.307 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:32:44.521 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 304942678031 -lt 304942678031 2026-02-18T01:32:44.522 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:32:44.522 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-317827579917 2026-02-18T01:32:44.523 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:32:44.523 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:32:44.524 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-317827579917 2026-02-18T01:32:44.525 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:32:44.526 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=317827579917 2026-02-18T01:32:44.526 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 317827579917' 2026-02-18T01:32:44.526 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.1 seq 317827579917 2026-02-18T01:32:44.527 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:32:44.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 317827579917 -lt 317827579917 2026-02-18T01:32:44.750 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:32:44.751 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-335007449099 2026-02-18T01:32:44.751 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:32:44.752 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:32:44.753 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-335007449099 2026-02-18T01:32:44.753 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:32:44.755 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=335007449099 2026-02-18T01:32:44.755 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 335007449099' 2026-02-18T01:32:44.755 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.2 seq 335007449099 2026-02-18T01:32:44.755 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:32:44.975 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 335007449099 -lt 335007449099 2026-02-18T01:32:44.975 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:32:44.976 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-347892350985 2026-02-18T01:32:44.976 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:32:44.977 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T01:32:44.978 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-347892350985 2026-02-18T01:32:44.978 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:32:44.979 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=347892350985 2026-02-18T01:32:44.979 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.3 seq 347892350985 2026-02-18T01:32:44.980 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 347892350985' 2026-02-18T01:32:44.980 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T01:32:45.193 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350985 -lt 347892350985 2026-02-18T01:32:45.193 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:32:45.194 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:32:45.194 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:32:45.481 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-18T01:32:45.481 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:32:45.481 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:32:45.481 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:32:45.481 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:32:45.481 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:32:45.482 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:32:45.482 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:32:45.687 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-18T01:32:45.688 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:32:45.688 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:32:45.688 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:32:45.966 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-18T01:32:45.966 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:32:45.967 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:32:45.967 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-18T01:32:45.967 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:32:45.967 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:32:45.967 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-18T01:32:45.967 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:32:45.967 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:32:45.967 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:32:45.967 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:32:45.967 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:32:46.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:32:46.277 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:32:46.278 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:32:46.278 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:32:46.280 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:32:46.280 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:32:46.281 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:32:46.282 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:32:46.282 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:32:46.283 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:32:46.283 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:32:46.284 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:32:46.285 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:32:46.285 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-18T01:32:52.538 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:32:52.538 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:32:52.538 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:32:52.538 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83061 2026-02-18T01:32:52.540 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:32:52.540 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:32:52.540 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-18T01:32:52.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-18T01:32:52.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:32:52.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-18T01:32:52.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:32:52.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:32:52.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-18T01:32:52.541 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:32:52.541 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:32:52.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:32:52.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:32:52.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:32:52.543 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:32:52.543 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:32:52.544 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:32:52.544 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:32:52.545 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:32:52.545 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:32:52.545 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:32:52.546 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:32:52.546 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:32:52.547 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:32:52.547 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:32:52.548 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:32:52.550 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:32:52.550 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-18T01:32:52.551 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:32:52.551 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:32:52.551 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:32:52.552 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83061 2026-02-18T01:32:52.553 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:32:52.553 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:32:52.553 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-18T01:32:52.554 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:32:52.554 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:32:52.554 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:32:52.554 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.83061 2026-02-18T01:32:52.556 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:32:52.557 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T01:32:52.557 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:32:52.557 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-18T01:32:52.557 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore2 td/osd-bluefs-volume-ops 2026-02-18T01:32:52.557 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:343: TEST_bluestore2: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:32:52.557 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: ulimit -n 2026-02-18T01:32:52.558 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: local flimit=4096 2026-02-18T01:32:52.559 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:346: TEST_bluestore2: '[' 4096 -lt 1536 ']' 2026-02-18T01:32:52.559 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: export CEPH_MON=127.0.0.1:7146 2026-02-18T01:32:52.559 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: CEPH_MON=127.0.0.1:7146 2026-02-18T01:32:52.559 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:350: TEST_bluestore2: export CEPH_ARGS 2026-02-18T01:32:52.559 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: uuidgen 2026-02-18T01:32:52.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: CEPH_ARGS+='--fsid=89fd4496-6e3f-44f4-b6f6-f97a0dc5c9a0 --auth-supported=none ' 2026-02-18T01:32:52.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:352: TEST_bluestore2: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-18T01:32:52.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:353: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-18T01:32:52.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:354: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-18T01:32:52.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:355: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-18T01:32:52.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:356: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-18T01:32:52.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:357: TEST_bluestore2: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-18T01:32:52.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:358: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-18T01:32:52.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:359: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-18T01:32:52.561 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:360: TEST_bluestore2: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-18T01:32:52.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:362: TEST_bluestore2: run_mon td/osd-bluefs-volume-ops a 2026-02-18T01:32:52.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:32:52.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:32:52.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:32:52.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:32:52.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-18T01:32:52.562 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-18T01:32:52.583 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:32:52.583 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:32:52.583 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:32:52.583 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:32:52.583 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:32:52.584 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:32:52.584 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:32:52.584 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T01:32:52.609 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:32:52.611 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:32:52.611 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:32:52.611 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:32:52.611 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:32:52.612 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:32:52.612 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:32:52.612 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:32:52.613 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:32:52.613 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:32:52.613 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:32:52.613 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:32:52.613 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83061/ceph-mon.a.asok 2026-02-18T01:32:52.613 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:32:52.613 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83061/ceph-mon.a.asok config get fsid 2026-02-18T01:32:52.670 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:32:52.670 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:32:52.670 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:32:52.670 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:32:52.670 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:32:52.671 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:32:52.671 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:32:52.671 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:32:52.672 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:32:52.672 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:32:52.672 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:32:52.672 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83061/ceph-mon.a.asok 2026-02-18T01:32:52.672 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:32:52.672 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83061/ceph-mon.a.asok config get mon_host 2026-02-18T01:32:52.727 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:363: TEST_bluestore2: run_mgr td/osd-bluefs-volume-ops x 2026-02-18T01:32:52.727 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:32:52.727 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:32:52.727 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T01:32:52.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:32:52.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-18T01:32:52.728 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:32:52.844 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:32:52.844 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:32:52.844 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:32:52.844 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:32:52.844 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:32:52.844 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:32:52.845 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:32:52.845 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:32:52.846 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:32:52.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:364: TEST_bluestore2: run_osd td/osd-bluefs-volume-ops 0 2026-02-18T01:32:52.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:32:52.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:32:52.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:32:52.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:32:52.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-18T01:32:52.868 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=89fd4496-6e3f-44f4-b6f6-f97a0dc5c9a0 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-18T01:32:52.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:32:52.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:32:52.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:32:52.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-18T01:32:52.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-18T01:32:52.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:32:52.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:32:52.869 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:32:52.869 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:32:52.869 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:32:52.869 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:32:52.869 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:32:52.870 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:32:52.871 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:32:52.871 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:32:52.871 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-18T01:32:52.871 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:32:52.871 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bcff41cd-5e3f-47cd-a04e-72c3b5b39873 2026-02-18T01:32:52.872 INFO:tasks.workunit.client.0.trial080.stdout:add osd0 bcff41cd-5e3f-47cd-a04e-72c3b5b39873 2026-02-18T01:32:52.872 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 bcff41cd-5e3f-47cd-a04e-72c3b5b39873' 2026-02-18T01:32:52.872 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:32:52.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDEFpVpO5y+MxAAv/GGfv8r5mi9Nf20KAxbkw== 2026-02-18T01:32:52.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDEFpVpO5y+MxAAv/GGfv8r5mi9Nf20KAxbkw=="}' 2026-02-18T01:32:52.882 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bcff41cd-5e3f-47cd-a04e-72c3b5b39873 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-18T01:32:52.995 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:32:53.003 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-18T01:32:53.004 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=89fd4496-6e3f-44f4-b6f6-f97a0dc5c9a0 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDEFpVpO5y+MxAAv/GGfv8r5mi9Nf20KAxbkw== --osd-uuid bcff41cd-5e3f-47cd-a04e-72c3b5b39873 2026-02-18T01:32:53.022 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:53.005+0000 7fb2a3cfaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:32:53.024 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:53.009+0000 7fb2a3cfaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:32:53.025 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:53.009+0000 7fb2a3cfaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:32:53.026 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:53.009+0000 7fb2a3cfaa40 -1 bdev(0x55754ab38c00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:32:53.026 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:53.009+0000 7fb2a3cfaa40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-18T01:32:54.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-18T01:32:54.555 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:32:54.556 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:32:54.557 INFO:tasks.workunit.client.0.trial080.stdout:adding osd0 key to auth repository 2026-02-18T01:32:54.557 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:32:54.686 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:32:54.686 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:32:54.687 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=89fd4496-6e3f-44f4-b6f6-f97a0dc5c9a0 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:32:54.687 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:32:54.687 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:32:54.687 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:32:54.713 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:54.697+0000 7fdf351a7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:32:54.714 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:54.697+0000 7fdf351a7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:32:54.715 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:54.701+0000 7fdf351a7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:32:54.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:32:54.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:32:54.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:32:54.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:32:54.801 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:32:54.801 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:54.801 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:32:54.801 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:32:54.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:54.802 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:32:54.914 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:32:55.289 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:55.273+0000 7fdf351a7a40 -1 Falling back to public interface 2026-02-18T01:32:55.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:32:55.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:55.915 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:32:55.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:32:55.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:55.915 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:32:56.134 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:32:56.333 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:32:56.317+0000 7fdf351a7a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:32:57.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:32:57.136 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:32:57.137 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:32:57.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:32:57.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:32:57.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:32:57.355 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/594684655,v1:127.0.0.1:6803/594684655] [v2:127.0.0.1:6804/594684655,v1:127.0.0.1:6805/594684655] exists,up bcff41cd-5e3f-47cd-a04e-72c3b5b39873 2026-02-18T01:32:57.356 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:32:57.356 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:32:57.356 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:32:57.357 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-18T01:32:57.357 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: osd_pid0=129819 2026-02-18T01:32:57.357 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:367: TEST_bluestore2: sleep 5 2026-02-18T01:33:02.358 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:368: TEST_bluestore2: create_pool foo 16 2026-02-18T01:33:02.359 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-18T01:33:02.621 INFO:tasks.workunit.client.0.trial080.stderr:pool 'foo' already exists 2026-02-18T01:33:02.631 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T01:33:03.632 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:370: TEST_bluestore2: retry = 0 2026-02-18T01:33:03.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 370: retry: command not found 2026-02-18T01:33:03.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:371: TEST_bluestore2: [[ '' -le 5 ]] 2026-02-18T01:33:03.633 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:373: TEST_bluestore2: timeout 60 rados bench -p foo 10 write --write-omap --no-cleanup 2026-02-18T01:33:03.655 INFO:tasks.workunit.client.0.trial080.stdout:hints = 1 2026-02-18T01:33:03.657 INFO:tasks.workunit.client.0.trial080.stdout:Maintaining 16 concurrent writes of 4194304 bytes to objects of size 4194304 for up to 10 seconds or 0 objects 2026-02-18T01:33:03.657 INFO:tasks.workunit.client.0.trial080.stdout:Object prefix: benchmark_data_trial080_132520 2026-02-18T01:33:03.702 INFO:tasks.workunit.client.0.trial080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T01:33:03.702 INFO:tasks.workunit.client.0.trial080.stdout: 0 0 0 0 0 0 - 0 2026-02-18T01:33:04.702 INFO:tasks.workunit.client.0.trial080.stdout: 1 16 177 161 643.93 644 0.0916416 0.0964085 2026-02-18T01:33:05.702 INFO:tasks.workunit.client.0.trial080.stdout: 2 16 374 358 715.927 788 0.0790818 0.0876432 2026-02-18T01:33:06.702 INFO:tasks.workunit.client.0.trial080.stdout: 3 16 550 534 711.931 704 0.0928524 0.0878811 2026-02-18T01:33:07.702 INFO:tasks.workunit.client.0.trial080.stdout: 4 16 737 721 720.933 748 0.0866691 0.0879426 2026-02-18T01:33:08.702 INFO:tasks.workunit.client.0.trial080.stdout: 5 16 934 918 734.333 788 0.0785511 0.0860589 2026-02-18T01:33:09.703 INFO:tasks.workunit.client.0.trial080.stdout: 6 16 1126 1110 739.932 768 0.0891197 0.0859154 2026-02-18T01:33:10.703 INFO:tasks.workunit.client.0.trial080.stdout: 7 16 1302 1286 734.787 704 0.0911185 0.0865705 2026-02-18T01:33:11.703 INFO:tasks.workunit.client.0.trial080.stdout: 8 16 1503 1487 743.429 804 0.091179 0.0856788 2026-02-18T01:33:12.703 INFO:tasks.workunit.client.0.trial080.stdout: 9 16 1686 1670 742.152 732 0.0971553 0.0856381 2026-02-18T01:33:13.703 INFO:tasks.workunit.client.0.trial080.stdout: 10 16 1878 1862 744.73 768 0.0765818 0.0854853 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Total time run: 10.0459 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Total writes made: 1878 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Write size: 4194304 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Object size: 4194304 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Bandwidth (MB/sec): 747.767 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Stddev Bandwidth: 49.4161 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Max bandwidth (MB/sec): 804 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Min bandwidth (MB/sec): 644 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Average IOPS: 186 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Stddev IOPS: 12.354 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Max IOPS: 201 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Min IOPS: 161 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Average Latency(s): 0.0854575 2026-02-18T01:33:14.703 INFO:tasks.workunit.client.0.trial080.stdout:Stddev Latency(s): 0.0116957 2026-02-18T01:33:14.704 INFO:tasks.workunit.client.0.trial080.stdout:Max latency(s): 0.132103 2026-02-18T01:33:14.704 INFO:tasks.workunit.client.0.trial080.stdout:Min latency(s): 0.0333511 2026-02-18T01:33:14.715 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:376: TEST_bluestore2: sleep 10 2026-02-18T01:33:24.718 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-18T01:33:24.718 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: jq .bluefs.db_used_bytes 2026-02-18T01:33:24.803 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: db_used=503316480 2026-02-18T01:33:24.804 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-18T01:33:24.804 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: jq .bluefs.slow_used_bytes 2026-02-18T01:33:24.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: spilled_over=165740544 2026-02-18T01:33:24.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:380: TEST_bluestore2: (( retry+=1 )) 2026-02-18T01:33:24.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: test 165740544 -eq 0 2026-02-18T01:33:24.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: break 2026-02-18T01:33:24.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:383: TEST_bluestore2: test 165740544 -gt 0 2026-02-18T01:33:24.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 129819 2026-02-18T01:33:24.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: sleep 1 2026-02-18T01:33:25.887 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 129819 2026-02-18T01:33:25.888 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 385: kill: (129819) - No such process 2026-02-18T01:33:25.888 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:386: TEST_bluestore2: ceph osd down 0 2026-02-18T01:33:26.095 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already down. 2026-02-18T01:33:26.104 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:388: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/block --command bluefs-bdev-migrate 2026-02-18T01:33:26.124 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:33:27.484 INFO:tasks.workunit.client.0.trial080.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-18T01:33:27.499 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:393: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command bluefs-bdev-sizes 2026-02-18T01:33:27.519 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:33:27.897 INFO:tasks.workunit.client.0.trial080.stdout:1 : device size 0x100000000(4 GiB) : using 0x27618000(630 MiB) 2026-02-18T01:33:27.995 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:396: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command fsck 2026-02-18T01:33:29.668 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:399: TEST_bluestore2: activate_osd td/osd-bluefs-volume-ops 0 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=89fd4496-6e3f-44f4-b6f6-f97a0dc5c9a0 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:33:29.744 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:33:29.745 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:33:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:33:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:33:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:33:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:33:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:33:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:33:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:33:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:33:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:33:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:33:29.745 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-18T01:33:29.746 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:33:29.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:33:29.747 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=89fd4496-6e3f-44f4-b6f6-f97a0dc5c9a0 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:33:29.747 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-18T01:33:29.748 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:33:29.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:33:29.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:33:29.749 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:33:29.774 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:29.757+0000 7f50c2943a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:33:29.775 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:29.757+0000 7f50c2943a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:33:29.776 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:29.761+0000 7f50c2943a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:33:29.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:33:29.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:33:29.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:33:29.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:33:29.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:33:29.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:33:29.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:33:29.965 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:33:29.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:33:29.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:33:30.146 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:30.129+0000 7f50c2943a40 -1 Falling back to public interface 2026-02-18T01:33:30.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:33:31.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:33:31.183 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:33:31.183 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:33:31.184 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:33:31.184 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:33:31.184 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:33:31.404 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:33:32.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:33:32.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:33:32.405 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:33:32.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:33:32.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:33:32.405 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:33:32.622 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:33:32.795 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:32.777+0000 7f50c2943a40 -1 osd.0 9 log_to_monitors true 2026-02-18T01:33:33.623 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:33:33.624 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:33:33.624 INFO:tasks.workunit.client.0.trial080.stdout:3 2026-02-18T01:33:33.624 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-18T01:33:33.624 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:33:33.624 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:33:33.836 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 12 up_thru 12 down_at 9 last_clean_interval [5,9) [v2:127.0.0.1:6802/4073155223,v1:127.0.0.1:6803/4073155223] [v2:127.0.0.1:6804/4073155223,v1:127.0.0.1:6805/4073155223] exists,up bcff41cd-5e3f-47cd-a04e-72c3b5b39873 2026-02-18T01:33:33.837 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:33:33.837 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:33:33.837 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:33:33.837 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-18T01:33:33.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: osd_pid0=133751 2026-02-18T01:33:33.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:402: TEST_bluestore2: wait_for_clean 2026-02-18T01:33:33.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:33:33.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:33:33.838 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:33:33.838 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:33:33.839 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:33:33.839 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:33:33.839 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:33:33.839 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:33:33.839 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:33:33.947 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:33:33.947 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:33:33.947 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:33:33.947 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:33:33.947 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:33:33.948 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:33:34.167 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T01:33:34.167 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:33:34.167 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:33:34.168 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:33:34.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607555 2026-02-18T01:33:34.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607555 2026-02-18T01:33:34.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-51539607555' 2026-02-18T01:33:34.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:33:34.249 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-51539607555 2026-02-18T01:33:34.249 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:33:34.250 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:33:34.251 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-51539607555 2026-02-18T01:33:34.251 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:33:34.252 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607555 2026-02-18T01:33:34.253 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 51539607555' 2026-02-18T01:33:34.253 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 51539607555 2026-02-18T01:33:34.253 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:33:34.462 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 51539607555 2026-02-18T01:33:34.463 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:33:35.464 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:33:35.464 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:33:35.686 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607555 -lt 51539607555 2026-02-18T01:33:35.687 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:33:35.687 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:33:35.688 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:33:35.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-18T01:33:35.966 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:33:35.966 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:33:35.967 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:33:35.967 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:33:35.967 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:33:35.967 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:33:35.967 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:33:36.181 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-18T01:33:36.182 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:33:36.182 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:33:36.182 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:33:36.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-18T01:33:36.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:33:36.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:33:36.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-18T01:33:36.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:33:36.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:33:36.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-18T01:33:36.474 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:33:36.475 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:33:36.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:33:36.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:33:36.475 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:33:36.783 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:33:36.783 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:33:36.785 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:33:36.785 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:33:36.787 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:33:36.787 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:33:36.788 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:33:36.789 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:33:36.789 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:33:36.789 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:33:36.789 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:33:36.790 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:33:36.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:33:36.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-18T01:33:37.123 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:33:37.123 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:33:37.123 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:33:37.123 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83061 2026-02-18T01:33:37.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:33:37.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:33:37.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-18T01:33:37.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-18T01:33:37.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:33:37.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-18T01:33:37.125 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:33:37.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:33:37.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-18T01:33:37.126 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:33:37.126 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:33:37.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:33:37.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:33:37.126 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:33:37.127 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:33:37.128 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:33:37.128 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:33:37.129 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:33:37.130 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:33:37.130 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:33:37.131 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:33:37.132 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:33:37.132 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:33:37.132 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:33:37.133 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:33:37.134 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:33:37.135 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:33:37.135 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-18T01:33:37.137 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:33:37.137 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:33:37.137 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:33:37.137 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83061 2026-02-18T01:33:37.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:33:37.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:33:37.138 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-18T01:33:37.139 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:33:37.139 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:33:37.139 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:33:37.140 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.83061 2026-02-18T01:33:37.141 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:33:37.142 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T01:33:37.142 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:33:37.142 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-18T01:33:37.142 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore_expand td/osd-bluefs-volume-ops 2026-02-18T01:33:37.142 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:406: TEST_bluestore_expand: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:33:37.142 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: ulimit -n 2026-02-18T01:33:37.143 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: local flimit=4096 2026-02-18T01:33:37.143 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:409: TEST_bluestore_expand: '[' 4096 -lt 1536 ']' 2026-02-18T01:33:37.143 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: export CEPH_MON=127.0.0.1:7146 2026-02-18T01:33:37.143 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: CEPH_MON=127.0.0.1:7146 2026-02-18T01:33:37.144 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:413: TEST_bluestore_expand: export CEPH_ARGS 2026-02-18T01:33:37.144 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: uuidgen 2026-02-18T01:33:37.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: CEPH_ARGS+='--fsid=894be15e-8191-4996-93a9-0323a50a7304 --auth-supported=none ' 2026-02-18T01:33:37.145 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:415: TEST_bluestore_expand: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:416: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:417: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:418: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:419: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:420: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:421: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:422: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:423: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:425: TEST_bluestore_expand: run_mon td/osd-bluefs-volume-ops a 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:33:37.146 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:33:37.147 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-18T01:33:37.147 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-18T01:33:37.170 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:33:37.170 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:33:37.171 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:33:37.171 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:33:37.172 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:33:37.172 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:33:37.172 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:33:37.172 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T01:33:37.203 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:33:37.204 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:33:37.205 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:33:37.205 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:33:37.205 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:33:37.206 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:33:37.206 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:33:37.206 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:33:37.206 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:33:37.206 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:33:37.206 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:33:37.206 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:33:37.207 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83061/ceph-mon.a.asok 2026-02-18T01:33:37.207 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:33:37.207 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83061/ceph-mon.a.asok config get fsid 2026-02-18T01:33:37.261 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:33:37.261 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:33:37.262 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:33:37.262 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:33:37.263 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:33:37.263 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:33:37.263 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:33:37.263 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:33:37.263 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:33:37.263 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:33:37.263 INFO:tasks.workunit.client.0.trial080.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:33:37.263 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83061/ceph-mon.a.asok 2026-02-18T01:33:37.264 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:33:37.264 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83061/ceph-mon.a.asok config get mon_host 2026-02-18T01:33:37.319 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:426: TEST_bluestore_expand: run_mgr td/osd-bluefs-volume-ops x 2026-02-18T01:33:37.319 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:33:37.319 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:33:37.319 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T01:33:37.319 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:33:37.319 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-18T01:33:37.319 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:33:37.432 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:33:37.432 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:33:37.432 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:33:37.433 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:33:37.433 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:33:37.433 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:33:37.433 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:33:37.434 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:33:37.435 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:33:37.458 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:427: TEST_bluestore_expand: run_osd td/osd-bluefs-volume-ops 0 2026-02-18T01:33:37.458 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:33:37.458 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:33:37.458 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:33:37.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:33:37.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-18T01:33:37.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=89fd4496-6e3f-44f4-b6f6-f97a0dc5c9a0 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=894be15e-8191-4996-93a9-0323a50a7304 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-18T01:33:37.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:33:37.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:33:37.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:33:37.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-18T01:33:37.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-18T01:33:37.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:33:37.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:33:37.459 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:33:37.460 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:33:37.461 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:33:37.461 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:33:37.461 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:33:37.461 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:33:37.461 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:33:37.461 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-18T01:33:37.462 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:33:37.462 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3af0db55-2c96-4dd2-9ee9-03bdef5db073 2026-02-18T01:33:37.462 INFO:tasks.workunit.client.0.trial080.stdout:add osd0 3af0db55-2c96-4dd2-9ee9-03bdef5db073 2026-02-18T01:33:37.462 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 3af0db55-2c96-4dd2-9ee9-03bdef5db073' 2026-02-18T01:33:37.463 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:33:37.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDxFpVp8IJjGxAA3U1VsMcWEl1piKKWBRuWag== 2026-02-18T01:33:37.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDxFpVp8IJjGxAA3U1VsMcWEl1piKKWBRuWag=="}' 2026-02-18T01:33:37.474 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3af0db55-2c96-4dd2-9ee9-03bdef5db073 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-18T01:33:37.588 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:33:37.596 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-18T01:33:37.597 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=89fd4496-6e3f-44f4-b6f6-f97a0dc5c9a0 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=894be15e-8191-4996-93a9-0323a50a7304 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDxFpVp8IJjGxAA3U1VsMcWEl1piKKWBRuWag== --osd-uuid 3af0db55-2c96-4dd2-9ee9-03bdef5db073 2026-02-18T01:33:37.617 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:37.601+0000 7f8893785a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:33:37.619 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:37.601+0000 7f8893785a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:33:37.620 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:37.601+0000 7f8893785a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:33:37.620 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:37.605+0000 7f8893785a40 -1 bdev(0x563d06d0ac00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:33:37.620 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:37.605+0000 7f8893785a40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-18T01:33:39.205 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-18T01:33:39.205 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:33:39.206 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:33:39.207 INFO:tasks.workunit.client.0.trial080.stdout:adding osd0 key to auth repository 2026-02-18T01:33:39.207 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:33:39.336 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:33:39.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:33:39.337 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=89fd4496-6e3f-44f4-b6f6-f97a0dc5c9a0 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=894be15e-8191-4996-93a9-0323a50a7304 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:33:39.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:33:39.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:33:39.338 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:33:39.369 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:39.352+0000 7ff5ef641a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:33:39.371 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:39.352+0000 7ff5ef641a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:33:39.372 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:39.356+0000 7ff5ef641a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:33:39.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:33:39.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:33:39.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:33:39.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:33:39.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:33:39.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:33:39.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:33:39.457 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:33:39.457 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:33:39.458 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:33:39.572 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:33:39.934 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:39.916+0000 7ff5ef641a40 -1 Falling back to public interface 2026-02-18T01:33:40.573 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:33:40.574 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:33:40.574 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:33:40.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:33:40.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:33:40.575 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:33:40.797 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:33:40.915 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:33:40.896+0000 7ff5ef641a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:33:41.798 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:33:41.799 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:33:41.799 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:33:41.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:33:41.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:33:41.800 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:33:42.018 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1278456396,v1:127.0.0.1:6803/1278456396] [v2:127.0.0.1:6804/1278456396,v1:127.0.0.1:6805/1278456396] exists,up 3af0db55-2c96-4dd2-9ee9-03bdef5db073 2026-02-18T01:33:42.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:33:42.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:33:42.019 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:33:42.019 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-18T01:33:42.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: osd_pid0=136310 2026-02-18T01:33:42.020 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:430: TEST_bluestore_expand: sleep 5 2026-02-18T01:33:47.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:431: TEST_bluestore_expand: create_pool foo 16 2026-02-18T01:33:47.021 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-18T01:33:47.285 INFO:tasks.workunit.client.0.trial080.stderr:pool 'foo' already exists 2026-02-18T01:33:47.295 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T01:33:48.297 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:434: TEST_bluestore_expand: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-18T01:33:48.321 INFO:tasks.workunit.client.0.trial080.stdout:hints = 1 2026-02-18T01:33:48.321 INFO:tasks.workunit.client.0.trial080.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-18T01:33:48.321 INFO:tasks.workunit.client.0.trial080.stdout:Object prefix: benchmark_data_trial080_138006 2026-02-18T01:33:48.321 INFO:tasks.workunit.client.0.trial080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T01:33:48.321 INFO:tasks.workunit.client.0.trial080.stdout: 0 0 0 0 0 0 - 0 2026-02-18T01:33:49.321 INFO:tasks.workunit.client.0.trial080.stdout: 1 16 16109 16093 62.8582 62.8633 0.00108151 0.000992947 2026-02-18T01:33:50.321 INFO:tasks.workunit.client.0.trial080.stdout: 2 16 32237 32221 62.9268 63 0.00189624 0.000992037 2026-02-18T01:33:51.321 INFO:tasks.workunit.client.0.trial080.stdout: 3 16 48267 48251 62.8221 62.6172 0.000946179 0.000993832 2026-02-18T01:33:52.321 INFO:tasks.workunit.client.0.trial080.stdout: 4 16 64078 64062 62.5559 61.7617 0.00184044 0.000998056 2026-02-18T01:33:53.321 INFO:tasks.workunit.client.0.trial080.stdout: 5 16 79907 79891 62.4102 61.832 0.00110961 0.00100041 2026-02-18T01:33:54.322 INFO:tasks.workunit.client.0.trial080.stdout: 6 16 95552 95536 62.1933 61.1133 0.000940188 0.00100394 2026-02-18T01:33:55.321 INFO:tasks.workunit.client.0.trial080.stdout: 7 16 110638 110622 61.7264 58.9297 0.00155106 0.00101153 2026-02-18T01:33:56.321 INFO:tasks.workunit.client.0.trial080.stdout: 8 16 124929 124913 60.9882 55.8242 0.00080695 0.00102383 2026-02-18T01:33:57.322 INFO:tasks.workunit.client.0.trial080.stdout: 9 16 139295 139279 60.4465 56.1172 0.00100859 0.00103301 2026-02-18T01:33:58.322 INFO:tasks.workunit.client.0.trial080.stdout: 10 16 153668 153652 60.0158 56.1445 0.000749363 0.00104041 2026-02-18T01:33:59.322 INFO:tasks.workunit.client.0.trial080.stdout: 11 16 167597 167581 59.5058 54.4102 0.00145274 0.00104935 2026-02-18T01:34:00.322 INFO:tasks.workunit.client.0.trial080.stdout: 12 16 181342 181326 59.0209 53.6914 0.00126075 0.00105798 2026-02-18T01:34:01.322 INFO:tasks.workunit.client.0.trial080.stdout: 13 16 195005 194989 58.586 53.3711 0.00089484 0.00106583 2026-02-18T01:34:02.322 INFO:tasks.workunit.client.0.trial080.stdout: 14 16 208631 208615 58.2028 53.2266 0.00130322 0.00107287 2026-02-18T01:34:03.322 INFO:tasks.workunit.client.0.trial080.stdout: 15 16 222468 222452 57.9257 54.0508 0.00108175 0.001078 2026-02-18T01:34:04.322 INFO:tasks.workunit.client.0.trial080.stdout: 16 16 236223 236207 57.6633 53.7305 0.00106482 0.00108291 2026-02-18T01:34:05.322 INFO:tasks.workunit.client.0.trial080.stdout: 17 16 249830 249814 57.3977 53.1523 0.00183084 0.00108793 2026-02-18T01:34:06.323 INFO:tasks.workunit.client.0.trial080.stdout: 18 16 263522 263506 57.18 53.4844 0.000950514 0.00109209 2026-02-18T01:34:07.322 INFO:tasks.workunit.client.0.trial080.stdout: 19 16 277243 277227 56.9912 53.5977 0.000614296 0.00109569 2026-02-18T01:34:08.323 INFO:tasks.workunit.client.0.trial080.stdout:2026-02-18T01:34:08.308734+0000 min lat: 0.000331887 max lat: 0.00637293 avg lat: 0.00109878 2026-02-18T01:34:08.323 INFO:tasks.workunit.client.0.trial080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T01:34:08.323 INFO:tasks.workunit.client.0.trial080.stdout: 20 16 291016 291000 56.8315 53.8008 0.00137404 0.00109878 2026-02-18T01:34:09.323 INFO:tasks.workunit.client.0.trial080.stdout: 21 16 304718 304702 56.6737 53.5234 0.00101965 0.00110185 2026-02-18T01:34:10.323 INFO:tasks.workunit.client.0.trial080.stdout: 22 16 318363 318347 56.5203 53.3008 0.00109518 0.00110484 2026-02-18T01:34:11.323 INFO:tasks.workunit.client.0.trial080.stdout: 23 16 328660 328644 55.8115 40.2227 0.0198367 0.00110796 2026-02-18T01:34:12.323 INFO:tasks.workunit.client.0.trial080.stdout: 24 16 329043 329027 53.5484 1.49609 0.017234 0.0011655 2026-02-18T01:34:13.323 INFO:tasks.workunit.client.0.trial080.stdout: 25 16 329659 329643 51.5027 2.40625 0.0233162 0.00121238 2026-02-18T01:34:14.323 INFO:tasks.workunit.client.0.trial080.stdout: 26 16 330224 330208 49.6067 2.20703 0.012061 0.00125782 2026-02-18T01:34:15.323 INFO:tasks.workunit.client.0.trial080.stdout: 27 16 330352 330336 47.788 0.5 0.125321 0.00130395 2026-02-18T01:34:16.323 INFO:tasks.workunit.client.0.trial080.stdout: 28 16 330487 330471 46.1001 0.527344 0.113691 0.00135227 2026-02-18T01:34:17.323 INFO:tasks.workunit.client.0.trial080.stdout: 29 16 342143 342127 46.0803 45.5312 0.00113201 0.00135537 2026-02-18T01:34:18.323 INFO:tasks.workunit.client.0.trial080.stdout:Total time run: 30.0013 2026-02-18T01:34:18.323 INFO:tasks.workunit.client.0.trial080.stdout:Total writes made: 355697 2026-02-18T01:34:18.323 INFO:tasks.workunit.client.0.trial080.stdout:Write size: 4096 2026-02-18T01:34:18.323 INFO:tasks.workunit.client.0.trial080.stdout:Object size: 4096 2026-02-18T01:34:18.323 INFO:tasks.workunit.client.0.trial080.stdout:Bandwidth (MB/sec): 46.3126 2026-02-18T01:34:18.323 INFO:tasks.workunit.client.0.trial080.stdout:Stddev Bandwidth: 21.308 2026-02-18T01:34:18.323 INFO:tasks.workunit.client.0.trial080.stdout:Max bandwidth (MB/sec): 63 2026-02-18T01:34:18.323 INFO:tasks.workunit.client.0.trial080.stdout:Min bandwidth (MB/sec): 0.5 2026-02-18T01:34:18.323 INFO:tasks.workunit.client.0.trial080.stdout:Average IOPS: 11856 2026-02-18T01:34:18.323 INFO:tasks.workunit.client.0.trial080.stdout:Stddev IOPS: 5454.85 2026-02-18T01:34:18.324 INFO:tasks.workunit.client.0.trial080.stdout:Max IOPS: 16128 2026-02-18T01:34:18.324 INFO:tasks.workunit.client.0.trial080.stdout:Min IOPS: 128 2026-02-18T01:34:18.324 INFO:tasks.workunit.client.0.trial080.stdout:Average Latency(s): 0.00134857 2026-02-18T01:34:18.324 INFO:tasks.workunit.client.0.trial080.stdout:Stddev Latency(s): 0.00476683 2026-02-18T01:34:18.324 INFO:tasks.workunit.client.0.trial080.stdout:Max latency(s): 0.358559 2026-02-18T01:34:18.324 INFO:tasks.workunit.client.0.trial080.stdout:Min latency(s): 0.000331887 2026-02-18T01:34:18.327 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:435: TEST_bluestore_expand: sleep 5 2026-02-18T01:34:23.330 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-18T01:34:23.330 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-18T01:34:23.416 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: total_space_before=4294967296 2026-02-18T01:34:23.417 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-18T01:34:23.417 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-18T01:34:23.417 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep free 2026-02-18T01:34:23.417 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d: -f 2 2026-02-18T01:34:23.417 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d, -f 1 2026-02-18T01:34:23.417 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-18T01:34:23.498 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: free_space_before=2837934080 2026-02-18T01:34:23.498 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 136310 2026-02-18T01:34:23.498 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: sleep 1 2026-02-18T01:34:24.499 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 136310 2026-02-18T01:34:24.500 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 441: kill: (136310) - No such process 2026-02-18T01:34:24.500 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:442: TEST_bluestore_expand: ceph osd down 0 2026-02-18T01:34:24.714 INFO:tasks.workunit.client.0.trial080.stderr:osd.0 is already down. 2026-02-18T01:34:24.723 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:445: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 allocmap 2026-02-18T01:34:24.748 INFO:tasks.workunit.client.0.trial080.stdout:allocmap bluestore.allocmap 2026-02-18T01:35:11.935 INFO:tasks.workunit.client.0.trial080.stdout:allocmap success 2026-02-18T01:35:11.976 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:448: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-18T01:36:01.523 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:36:01.565 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:450: TEST_bluestore_expand: requested_space=4294967296 2026-02-18T01:36:01.565 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:451: TEST_bluestore_expand: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-18T01:36:01.566 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:452: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-18T01:36:01.584 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:36:49.253 INFO:tasks.workunit.client.0.trial080.stdout:1 : device size 0x40000000(1 GiB) : using 0x29a00000(666 MiB) 2026-02-18T01:36:49.253 INFO:tasks.workunit.client.0.trial080.stdout:2 : device size 0x100000000(4 GiB) : using 0x56d8b000(1.4 GiB) 2026-02-18T01:36:49.253 INFO:tasks.workunit.client.0.trial080.stdout:Expanding DB/WAL... 2026-02-18T01:36:49.253 INFO:tasks.workunit.client.0.trial080.stdout:1 : nothing to do, skipped 2026-02-18T01:36:49.254 INFO:tasks.workunit.client.0.trial080.stdout:2 : nothing to do, skipped 2026-02-18T01:36:49.386 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:455: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-18T01:37:41.300 INFO:tasks.workunit.client.0.trial080.stdout:fsck success 2026-02-18T01:37:41.346 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:458: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 qfsck 2026-02-18T01:37:41.370 INFO:tasks.workunit.client.0.trial080.stdout:qfsck bluestore.quick-fsck 2026-02-18T01:38:28.400 INFO:tasks.workunit.client.0.trial080.stdout:qfsck success 2026-02-18T01:38:28.426 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:460: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-18T01:38:28.443 INFO:tasks.workunit.client.0.trial080.stdout:inferring bluefs devices from bluestore path 2026-02-18T01:39:14.513 INFO:tasks.workunit.client.0.trial080.stdout:1 : device size 0x40000000(1 GiB) : using 0x29a00000(666 MiB) 2026-02-18T01:39:14.513 INFO:tasks.workunit.client.0.trial080.stdout:2 : device size 0x100000000(4 GiB) : using 0x56d8b000(1.4 GiB) 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:462: TEST_bluestore_expand: activate_osd td/osd-bluefs-volume-ops 0 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=89fd4496-6e3f-44f4-b6f6-f97a0dc5c9a0 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=894be15e-8191-4996-93a9-0323a50a7304 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-18T01:39:14.654 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:39:14.655 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:39:14.656 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:39:14.656 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:39:14.656 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:39:14.656 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-18T01:39:14.656 INFO:tasks.workunit.client.0.trial080.stdout:start osd.0 2026-02-18T01:39:14.656 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:39:14.657 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=3723ff40-3685-471a-a79f-84beedf8fcb4 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=89fd4496-6e3f-44f4-b6f6-f97a0dc5c9a0 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=894be15e-8191-4996-93a9-0323a50a7304 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83061/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:39:14.657 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-18T01:39:14.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:39:14.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:39:14.658 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:39:14.659 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:39:14.684 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:39:14.672+0000 7f59f12bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:39:14.686 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:39:14.672+0000 7f59f12bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:39:14.687 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:39:14.672+0000 7f59f12bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:39:14.877 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:39:14.878 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:39:14.878 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:39:14.878 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:39:14.878 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:39:14.878 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:14.878 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:39:14.879 INFO:tasks.workunit.client.0.trial080.stdout:0 2026-02-18T01:39:14.879 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:14.879 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:15.097 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:39:15.177 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:39:15.164+0000 7f59f12bea40 -1 Falling back to public interface 2026-02-18T01:39:16.098 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:39:16.098 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:16.099 INFO:tasks.workunit.client.0.trial080.stdout:1 2026-02-18T01:39:16.099 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:39:16.099 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:16.100 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:16.318 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:39:17.319 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:39:17.320 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:17.320 INFO:tasks.workunit.client.0.trial080.stdout:2 2026-02-18T01:39:17.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:39:17.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:17.321 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:17.538 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:39:18.539 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:39:18.540 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:18.540 INFO:tasks.workunit.client.0.trial080.stdout:3 2026-02-18T01:39:18.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-18T01:39:18.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:18.541 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:18.758 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:39:19.759 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:39:19.759 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:19.759 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-18T01:39:19.759 INFO:tasks.workunit.client.0.trial080.stdout:4 2026-02-18T01:39:19.760 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:19.760 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:19.978 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:39:20.979 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:39:20.979 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:20.979 INFO:tasks.workunit.client.0.trial080.stdout:5 2026-02-18T01:39:20.980 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-18T01:39:20.980 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:20.980 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:21.201 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:39:22.202 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:39:22.203 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:22.203 INFO:tasks.workunit.client.0.trial080.stdout:6 2026-02-18T01:39:22.203 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-18T01:39:22.204 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:22.204 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:22.604 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:39:23.605 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:39:23.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:23.606 INFO:tasks.workunit.client.0.trial080.stdout:7 2026-02-18T01:39:23.606 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-18T01:39:23.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:23.607 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:23.819 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:39:24.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:39:24.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:24.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-18T01:39:24.821 INFO:tasks.workunit.client.0.trial080.stdout:8 2026-02-18T01:39:24.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:24.821 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:25.041 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:39:26.043 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:39:26.044 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:26.044 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2026-02-18T01:39:26.045 INFO:tasks.workunit.client.0.trial080.stdout:9 2026-02-18T01:39:26.045 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:26.045 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:26.262 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:39:27.264 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:39:27.264 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:27.264 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2026-02-18T01:39:27.264 INFO:tasks.workunit.client.0.trial080.stdout:10 2026-02-18T01:39:27.265 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:27.265 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:27.482 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:39:28.484 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:39:28.484 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:28.484 INFO:tasks.workunit.client.0.trial080.stdout:11 2026-02-18T01:39:28.485 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2026-02-18T01:39:28.485 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:28.485 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:28.705 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:39:29.153 INFO:tasks.workunit.client.0.trial080.stderr:2026-02-18T01:39:29.141+0000 7f59f12bea40 -1 osd.0 10 log_to_monitors true 2026-02-18T01:39:29.707 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:39:29.707 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:39:29.707 INFO:tasks.workunit.client.0.trial080.stdout:12 2026-02-18T01:39:29.707 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2026-02-18T01:39:29.707 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:39:29.708 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:39:29.917 INFO:tasks.workunit.client.0.trial080.stdout:osd.0 up in weight 1 up_from 13 up_thru 13 down_at 10 last_clean_interval [5,10) [v2:127.0.0.1:6802/1688953691,v1:127.0.0.1:6803/1688953691] [v2:127.0.0.1:6804/1688953691,v1:127.0.0.1:6805/1688953691] exists,up 3af0db55-2c96-4dd2-9ee9-03bdef5db073 2026-02-18T01:39:29.918 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:39:29.918 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:39:29.918 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:39:29.918 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-18T01:39:29.919 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: osd_pid0=140380 2026-02-18T01:39:29.919 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:465: TEST_bluestore_expand: wait_for_clean 2026-02-18T01:39:29.920 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:39:29.920 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:39:29.920 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:39:29.920 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:39:29.921 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:39:29.921 INFO:tasks.workunit.client.0.trial080.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:39:29.921 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:39:29.921 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:39:29.921 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:39:30.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:39:30.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:39:30.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:39:30.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:39:30.026 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:39:30.026 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:39:30.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T01:39:30.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:39:30.248 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:39:30.248 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:39:30.330 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-18T01:39:30.330 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-18T01:39:30.330 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-55834574851' 2026-02-18T01:39:30.330 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:39:30.330 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-55834574851 2026-02-18T01:39:30.331 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:39:30.333 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:39:30.333 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-55834574851 2026-02-18T01:39:30.334 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:39:30.334 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574851 2026-02-18T01:39:30.335 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 55834574851' 2026-02-18T01:39:30.335 INFO:tasks.workunit.client.0.trial080.stdout:waiting osd.0 seq 55834574851 2026-02-18T01:39:30.335 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:39:30.557 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 55834574851 2026-02-18T01:39:30.557 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:39:31.559 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:39:31.559 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:39:31.778 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 55834574851 2026-02-18T01:39:31.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:39:32.779 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T01:39:32.780 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:39:33.001 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-18T01:39:33.002 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:39:33.002 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:39:33.002 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:39:33.291 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-18T01:39:33.291 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:39:33.291 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:39:33.292 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:39:33.292 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:39:33.292 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:39:33.292 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:39:33.292 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:39:33.507 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-18T01:39:33.508 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:39:33.508 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:39:33.508 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:39:33.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-18T01:39:33.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:39:33.792 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:39:33.793 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-18T01:39:33.793 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-18T01:39:33.876 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: total_space_after=4294967296 2026-02-18T01:39:33.878 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-18T01:39:33.878 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-18T01:39:33.878 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep free 2026-02-18T01:39:33.878 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d: -f 2 2026-02-18T01:39:33.878 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d, -f 1 2026-02-18T01:39:33.878 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-18T01:39:33.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: free_space_after=2811088896 2026-02-18T01:39:33.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:470: TEST_bluestore_expand: '[' 4294967296 '!=' 4294967296 ']' 2026-02-18T01:39:33.961 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:476: TEST_bluestore_expand: total_space_added=0 2026-02-18T01:39:33.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:477: TEST_bluestore_expand: free_space_added=-26845184 2026-02-18T01:39:33.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:479: TEST_bluestore_expand: let 'new_used_space=(0 - -26845184)' 2026-02-18T01:39:33.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:480: TEST_bluestore_expand: echo 26845184 2026-02-18T01:39:33.962 INFO:tasks.workunit.client.0.trial080.stdout:26845184 2026-02-18T01:39:33.962 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:482: TEST_bluestore_expand: '[' 26845184 -gt 131072 ']' 2026-02-18T01:39:33.963 INFO:tasks.workunit.client.0.trial080.stdout:total_space_added = 0 2026-02-18T01:39:33.963 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:483: TEST_bluestore_expand: echo 'total_space_added = 0' 2026-02-18T01:39:33.963 INFO:tasks.workunit.client.0.trial080.stdout:free_space_added = -26845184 2026-02-18T01:39:33.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:484: TEST_bluestore_expand: echo 'free_space_added = -26845184' 2026-02-18T01:39:33.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:485: TEST_bluestore_expand: return 1 2026-02-18T01:39:33.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: return 1 2026-02-18T01:39:33.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: main: code=1 2026-02-18T01:39:33.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/osd-bluefs-volume-ops 1 2026-02-18T01:39:33.965 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-18T01:39:33.966 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=1 2026-02-18T01:39:33.966 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-18T01:39:33.966 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:39:33.966 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:39:33.966 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:39:33.966 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:39:33.966 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:39:34.270 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:39:34.271 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:39:34.271 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:39:34.272 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:39:34.274 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:39:34.274 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:39:34.274 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:39:34.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:39:34.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:39:34.276 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:39:34.277 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:39:34.278 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:39:34.279 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 1 = 1 ']' 2026-02-18T01:39:34.280 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:181: teardown: '[' -n '' ']' 2026-02-18T01:39:34.280 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:185: teardown: mkdir -p /home/ubuntu/cephtest/archive/log 2026-02-18T01:39:34.280 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:186: teardown: mv td/osd-bluefs-volume-ops/bluestore_tool.log td/osd-bluefs-volume-ops/mgr.x.log td/osd-bluefs-volume-ops/mon.a.log td/osd-bluefs-volume-ops/osd.0.log /home/ubuntu/cephtest/archive/log 2026-02-18T01:39:34.281 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-18T01:39:34.347 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:39:34.347 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:39:34.347 INFO:tasks.workunit.client.0.trial080.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83061 2026-02-18T01:39:34.347 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83061 2026-02-18T01:39:34.348 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:39:34.348 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:39:34.348 INFO:tasks.workunit.client.0.trial080.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 1 2026-02-18T01:39:34.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T01:39:34.350 INFO:tasks.workunit:Stopping ['osd'] on client.0... 2026-02-18T01:39:34.351 DEBUG:teuthology.orchestra.run.trial080:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-18T01:39:34.707 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa/tasks/workunit.py", line 144, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa/tasks/workunit.py", line 292, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa/tasks/workunit.py", line 433, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial080 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh' 2026-02-18T01:39:34.714 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-18T01:39:34.738 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-18T01:39:34.739 DEBUG:teuthology.orchestra.run.trial080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T01:39:34.827 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-18T01:39:34.838 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-18T01:39:34.838 DEBUG:teuthology.orchestra.run.trial080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T01:39:34.945 INFO:teuthology.orchestra.run.trial080.stdout: remote refid st t when poll reach delay offset jitter 2026-02-18T01:39:34.945 INFO:teuthology.orchestra.run.trial080.stdout:============================================================================== 2026-02-18T01:39:34.945 INFO:teuthology.orchestra.run.trial080.stdout:+108.61.73.243 129.6.15.28 2 u 6 64 377 3.441 +12.526 1.764 2026-02-18T01:39:34.946 INFO:teuthology.orchestra.run.trial080.stdout:+149.248.12.167 23.95.49.216 3 u 5 64 377 62.748 +12.063 2.908 2026-02-18T01:39:34.946 INFO:teuthology.orchestra.run.trial080.stdout:*173.10.119.145 .GPS. 1 u 4 64 377 79.099 +8.444 5.310 2026-02-18T01:39:34.946 INFO:teuthology.orchestra.run.trial080.stdout:+216.82.35.115 129.6.15.25 2 u 5 64 377 25.683 +8.474 2.346 2026-02-18T01:39:34.947 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-18T01:39:34.958 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-18T01:39:34.959 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-18T01:39:34.974 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-18T01:39:34.986 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-18T01:39:35.004 INFO:teuthology.task.internal:Duration was 1588.700955 seconds 2026-02-18T01:39:35.004 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-18T01:39:35.018 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-18T01:39:35.019 DEBUG:teuthology.orchestra.run.trial080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T01:39:35.043 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-18T01:39:35.043 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial080.front.sepia.ceph.com 2026-02-18T01:39:35.044 DEBUG:teuthology.orchestra.run.trial080:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T01:39:35.093 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-18T01:39:35.094 DEBUG:teuthology.orchestra.run.trial080:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T01:39:35.306 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-18T01:39:35.306 DEBUG:teuthology.orchestra.run.trial080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T01:39:35.315 INFO:teuthology.orchestra.run.trial080.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T01:39:35.316 INFO:teuthology.orchestra.run.trial080.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T01:39:35.317 INFO:teuthology.orchestra.run.trial080.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T01:39:35.317 INFO:teuthology.orchestra.run.trial080.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T01:39:35.317 INFO:teuthology.orchestra.run.trial080.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T01:39:35.365 INFO:teuthology.orchestra.run.trial080.stderr: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T01:39:35.367 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-18T01:39:35.383 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-18T01:39:35.384 DEBUG:teuthology.orchestra.run.trial080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T01:39:35.423 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-18T01:39:35.439 DEBUG:teuthology.orchestra.run.trial080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:39:35.475 INFO:teuthology.orchestra.run.trial080.stdout:kernel.core_pattern = core 2026-02-18T01:39:35.483 DEBUG:teuthology.orchestra.run.trial080:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:39:35.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T01:39:35.527 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-18T01:39:35.543 INFO:teuthology.task.internal:Transferring archived files... 2026-02-18T01:39:35.545 DEBUG:teuthology.misc:Transferring archived files from trial080:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:14:21-rados-20.2.1_2.17.26-baseline_2-distro-default-trial/54269/remote/trial080 2026-02-18T01:39:35.547 DEBUG:teuthology.orchestra.run.trial080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T02:41:01.041 INFO:teuthology.task.internal:Removing archive directory... 2026-02-18T02:41:01.051 DEBUG:teuthology.orchestra.run.trial080:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T02:41:04.805 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-18T02:41:04.822 INFO:teuthology.task.internal:Not uploading archives. 2026-02-18T02:41:04.822 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-18T02:41:04.837 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-18T02:41:04.838 DEBUG:teuthology.orchestra.run.trial080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T02:41:04.842 INFO:teuthology.orchestra.run.trial080.stdout: 1180220 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 18 02:41 /home/ubuntu/cephtest 2026-02-18T02:41:04.843 INFO:teuthology.orchestra.run.trial080.stdout: 1189814 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 18 01:14 /home/ubuntu/cephtest/mnt.0 2026-02-18T02:41:04.843 INFO:teuthology.orchestra.run.trial080.stdout: 1189815 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 18 01:25 /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T02:41:04.843 INFO:teuthology.orchestra.run.trial080.stdout: 1205477 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 18 01:25 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T02:41:04.843 INFO:teuthology.orchestra.run.trial080.stdout: 1205478 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Feb 18 01:39 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td 2026-02-18T02:41:04.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T02:41:04.844 INFO:teuthology.orchestra.run.trial080.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-18T02:41:04.845 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial080 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-18T02:41:04.847 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-18T02:41:04.863 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-18T02:41:04.880 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial080 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-18T02:41:04.886 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} duration: 1588.7009553909302 failure_reason: 'Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial080 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh''' flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-18T02:41:04.886 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-18T02:41:05.003 INFO:teuthology.run:FAIL